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ABSTRACT 


Advanced surveillance and weapon guidance systems using 
new mosaic sensor arrays and large scale integration (LSI) 
electronic data processors on the same focal plane require 
detection of weak targets deeply buried in background clutter 
noise by many tens of db's. This investigation reports on 
BHL e2l plane processing techniques to accomplish these 
heretofore unachievable goals. 

Five focal plane processing algorithms are developed con- 
meer of nonrecursive statistical spatial-temporal filters 
for clutter suppression followed by thresholding for initial- 
ization of target detection. These filters are based on either 
the Minimization of mean square error criterion (for MMSE 
INES) Or the maximization of signal to noise ratio cri- 
terion (for matched filters). Two are nonadaptive spatial 
ιν, απα two are nonadaptive spatial-temporal filters. 
ch type is an adaptive spatial filter based on the 
Zei zatıon of mean square error criterion. 

These filters have been investigated analytically and by 
υπ ατον simulation using computer generated images contain- 
Meor elated clutter noises modeled by Markov processes and 
also real world infrared images. Using an infrared image in 
Ae Spike spectral band, a single frame statistical 
ο το £11iter can suppress the clutter by Z7 db. A five 
frame sequential statistical spatial-temporal filter was 
Bouma to have a clutter suppression of 87 db. 
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I. INTRODUCTION 


A. MOSAIC FOCAL PLANE AND SMART SENSOR DEVELOPMENTS 

Il enormous impact of integrated circuit technologies on 
baseband electronics is well known. Revolutionary advances 
NS (large scale integration) and VLSI (very large scale 
Euoration) devices are making high performance computer and 
Eus processing capabilities available at lower cost with 
ter weight, less power consumption and higher reliability. 
Beer impact on military systems will be tremendous and far- 
B-oching. 

E  -cenrt-oyears, IC technologies have also been making 
Miportant Changes in high frequency electronics throughout 
Nu EUCrowave and optical bands. In optical detection tech- 
nologies, thousands and hundreds of thousands of optical and 
infrared detectors can be made in the not too distant future 
Bone chip by IC batch processing in the form of what is 
ΙΙ known as "mosaic detector array" or "mosaic focal 
Eu array" [1]. The availability of such a large number 
Or detectors on the same focal plane has inspired new modes 
Of optical detection, such as the time-delayed-integration 
Euneng 12], staring [3], and step-staring [3] modes which 
Ec better detection performance. Combined with LSI com- 
puters or signal processors on the same focal plane, complex 


E can now be carried out at or near the focal plane by 





1 
Mia are called "smart sensors.' 


m egui pment 1s Intelligent, 
Email, light, comsumes little power and is not expensive. It 
EN tain that these smart sensors are going to make signif- 
Eu mnprovements to many surveillance, reconnaissance and 
@urdance systems. 

This thesis deals with an image processing, or more 
ια, a "focal plane processing" problem which is 


Eg by these new '"mosaic focal plane" and "smart sensor" 
D 


E Nopments. It will be explained in the next section. 


REQUIREMENTS OF NEW FOCAL PLANE PROCESSING 

With the new-found computing and signal processing capa- 
Eres which will be mounted next to the detector array in 
the near future, very ambitious focal plane processing objec- 
Mires Nave been formulated. In front of the mosaic detector 
array, computer controlled adaptive optics and programmable 
Optical filters are being developed. On the mosaic detector 
Aca plane, sophisticated "on chip" signal processing oper- 
Bons such as time-delayed integration [2], a.c. coupling [41], 
Seeererentiation [5], multiplexing [6], convolutional read-out 
and others are being investigated. After, or during, the 
Mmeaa-Out, image processing operations of sampled analog signals 
Eube carried out. If digital focal plane processing is used, 
signal formating, sample and hold and analog to digital 


conversion must be performed. 





I "Smart sensors" a Donna DE 1979 East Symposium to 
Brzpeid in Washington, D.C. April 17-18, 1979. 


u 





. 45 appitcacions of surveillance, reconnaissance 
EE uIdance, focal plane processing objectives include the 
basic signal manipulations described above and other predetec- 
Mmeemesteps, such as background clutter suppression, target 
we ement and thresholding for initialization of target 
τοπ. Following this, there are many post-thresholding 
Memeo tane processing steps such as target linking, track- 
miei rack assembly, track association, trajectory estimation, 
EN ct discrimination, target recognition, and many others. 
This thesis is concerned with the predetection steps of 
BENsKpround clutter suppression and thresholding for initial- 
ization of target detection. 

lE sosble imaging systems, the contrast between targets 
EEbackscround is usually high. The target signal to noise 
EIUS often quite adequate. Therefore, focal plane process- 
Env operations of visible images can directly deal with target 
Anais and background noise in most cases without any pre- 
en to improve the signal to noise ratio. However, 
in infrared imaging systems, the contrasts between targets 
and backgrounds are much smaller. Target signals are often 
a very small fraction of the incoming signal which consists 
ot a large amount of background clutter noise and other white 
noise. All infrared imaging systems must deal with the 
Mco problem. The need of suppressing background clutter 
ema detecting targets buried in clutter certainly is not unique 


in these new mosaic focal plane arrays. However, the 


Jot 





megmarements of clutter suppression and target detection are 
now much more demanding because of the improved performance 
of mosaic focal plane sensors processors and much more 
ambitious system goals. In new surveillance and guidance 
systems, it is sometimes required to detect weak targets 
meee, buried in clutter by many ten's of db's. Old pro- 
cessing techniques used to separate targets from clutter are 
Eu Not adequate to meet these requirements. New process- 
ane techniques using spatial, temporal and spectral character- 
istics of both the targets and clutter must be developed. 
These techniques are different from most of the well known 
image processing techniques in two major aspects: 

They deal with image signals of very low signal to 
noise ratio. Furthermore, the dominant noise com- 


ponent is due to clutter and is correlated rather 


than white. 

The signals of interest are usually point targets, 
mite swtargets and targets of different shapes instead 
ENEOSGtoria]) details of the image. 

στ they are cailed "focal plane processing" in this 
mimesis instead of the widely used name of "image processing" 
Eno usually concerns pictures, photographs, TV pictures, 


EFC. 


ENMLOCAL PEANE PROCESSING TECHNIQUES FOR BACKGROUND 
EEUSUUERSSUPPRESSION AND TARGET DETECTION 


Clutter suppression and target detection are not unique 


problems for mosaic focal plane processing. Similar types 


NP 





of problems exist in radar and sonar processing and have been 
Mememsively investigated [7,8]. Effective processing algor- 
meds tor Clutter suppression and thresholding for target 
detection have been well developed. However, there are sig- 
nificant differences between mosaic focal plane systems and 
radar and sonar systems so that most of the developed process- 
ing algorithms either are not applicable or must be modified 
MAY are to be used for imaging systems. The major dif- 
ferences are the following: 

1. Imaging systems are mostly passive. Therefore, 
processing algorithms based on Doppler shift or the signal 
waveform cannot be applied to passive optical systems. 

mare sienals are three dimensional, which includes 
two dimensional spatial variations on a single image frame 
and one dimensional temporal variations on several frames of 
images. Radar and sonar signals are mostly one dimensional 
With temporal variations. Therefore, radar and sonar pro- 
Cessing algorithms must be modified if they are applicable 
to mosaic focal plane problems. 

In spite of these differences, the concepts of most signal 
EN cssing approaches can be applied to the new problems. In 
EU Erollowing, several processing approaches for target 
enhancement and detection are listed. 

IuuEsUonal to noise ratio is above unity, thresholding 
Can be applied to separate true targets from background noise. 


I threshold level can be determined from several different 





E Πεταζίοπο; for example, based on a constant false alarm 
meee (crAR), or on a given probability of detection, or on a 
Mieeemeprobability of tracking, etc. 

πε signal to noise ratio is low, as in many practical 
BEN Urons, prethresholding signal processing steps must be 
Med to suppress the noise and enhance the target, if 
Messtole, so that the signal to noise ratio will be adequate 
for thresholding. Some of these’ processing approaches are 


Mased on the following concepts: 


nming - Time integration 
Differencing - pulse canceller 
Erl ering: 


Based on time domain knowledge - correlator 


Based on frequency domain knowledge - frequency 
domain filter 


Mer approaches are statistical, based on the following 
EMuscedures: 
Eu UNcaloorocessing: 


τ: τπτ 5ισπαὶ sto noise ratio - statistical 
matched filter 
Minimization of mean square error 


Kalman filter 
Nietmiem@eriiter, MMSE filter 


ame eron ot likelihood filter 


The principles of some of these signal processing approaches 


have been extended and applied to the focal plane processing 


14 





mobNems by other investigators for background clutter sup- 
MEME». Some are deterministic processing, based on the 
BENNNoOWw)no concepts: 
Weremmimistiecalily Designed Focal Plane Processing: 
ο ση ane processing = Spatial filters: 


Masking = First order, Second order (Laplacian), 
Fourth order [9] 


Summing - Time-delayed integration [2] 
Maple s@rame processing = Temporal filters: 


ο μπα ο ici) te frame integration 


Differencing - Frame to frame differencing, Non- 
recursive Second differencing, Third 
differencing, etc. [10] 


De e Recursive digital high pass filters 
based on the knowledge of frequency 
ani reas es "On the clutter {11} 
οτι ο Dand pass filters. 


Ex I statistically designed processing approaches have 
also been investigated. 
EcUUtycaljy Designed Focal Plane Processing: 


Single frame processing: 
Seater Kaiman tilter [i2,13] 
προ τα) MMSE filter [13] 


ο το απο processing = Temporal filter 
Maximum likelihood filter [15] 
EN 5seh quite a few processing algorithms are listed above, 
EU the deterministic single frame spatial filters and the 
multiple frame differencing filters have been substantially 
developed. All other processing approaches have only received 


E liminary investigation. None of these filters have shown 


S 





ED Eclutter suppression capabilities to enable detection 
EN Sk targets more than 70 db below clutter. 
IE OCAL PLANE PROCESSING TECHNIQUES 

EENCEOPED IN THIS THESIS 

M objective of this thesis investigation was to develop 
memerstical processing algorithms for background clutter 
Be 1ο. This is accomplished in several phases. First, 
Eum procedures are developed for two types of nonrecursive 
spatial νιν ese concepts are then extended to three 
mensions by adding a temporal filter. Several aspects of 
EN c detection are also addressed, with special considera- 
m UESTyen to cases involving non-Gaussian probability 
155. Adaptive filter algorithms are also developed 
EU Estuations involving unknown and non-stationary statistics 
Background clutter noise. Analytical results and computer 
Simulation studies demonstrate the feasibility of the filter 
MeeOriehnms proposed. The following paragraphs describe in 
merenwaetail the development of the processing techniques. 

chapter II the basic structure of nonrecursive spatial 
Geese temporal filters is introduced. The spatial filters, 
Muay be adaptive, utilize image signals in the neighbor- 
E : τε "estimation pixel'" to suppress clutter and enhance 
Meee intensity at the estimation pixel. Further improvement 
Memoocained by also processing spatially filtered data from 


adjacent image frames. 


16 





Mess tons tom the filter coefficients are derived in 
Mer Ill for two criteria which have been previously used 
in One-dimensional statistical processing filters [16]: min- 
MA tion of mean square error (MMSE) and maximization of 
Ms icnal to noise ratio (matched filter). Statistical 
nonrecursive spatial filters based on the MMSE criterion have 
been studied before for image restoration and for improvement 
EN Nnal to noise ratio against white noise [25-25]. The 
EE 5i these filters, however, is carried out using spatial 
οπου domain techniques, or equivalent. Such filters have 
not been very useful in practical applications because of the 
EE 226, e.g., larger than 10x10, required to achieve 
meaningful improvement [25]. Furthermore, a nonrecursive 
spatial filter tends to blur the edges of an object [17]. The 
END oft using nonrecursive statistical spatial filters for 
suppression of correlated noise was originated by Bar Yehoshua 
[11] who developed a design procedure in the spatial domain 
meme the MMSE criterion. Bar Yehoshua developed the special 
ENNEStIiOn of statistical nonrecursive spatial filters for 
EuUSmeement of point/line target signal to noise ratio in the 
EN ence or spatially correlated noise. He showed that spa- 
EU cilters as small as 3x3 pixels are effective in the 
wep ession of spatially correlated noise. Furthermore, his 
design procedure in the spatial domain is well suited for hard- 
ware implementation because the rather complex two dimensional 


transformation operations required in spatial frequency 


τ 





G@omain design procedures are unnecessary. Chapter III reviews 
Bar Yehoshua's work and extends the concept to nonrecursive 
EI matched filters. Other related work is contained in 
meee the matched filter for the enhancement of point and 
line targets described here is applicable to correlated, as 
well as white, noise. In addition, a new explicit design 

E cgure is presented. This thesis extends Bar Yehoshua's 
Et in three directions. In this chapter, a different 
design criterion based on the maximization of signal to noise 
maemo is developed for the second type of nonrecursive spatial 
eeter- -matched filter. Again, spatial matched filters are 
EDEN [17,18]. The contribution of this study is in the 
development of its new application to the enhancement of point/ 
[ememcarcet to noise ratio in two dimensional and three dimen- 
Sronal images of very low signal to noise ratio, and in the 
EEUPn procedure in spatial and temporal domains instead of 
the spatial frequency and temporal frequency used bv most 
emer workers. Extensions in two other directions will be 

EE Uu»ed in Chapter IV and Chapter VII. 

In Chapter IV, two nonadaptive multiple frame processing 
Booaches for clutter suppression are developed. They are 
EIN nrecurszve sequential spatial-temporal filters designed 
again by two statistical criteria similar to those in Chapter 
EM which lead to the spatial-temporai MMSE filters and the 
E: temporali matched filters. Temporal filters which 


Se several frames of image designed by either deterministic 


18 





MS tatistical information are not new [17]. However, the 
EUEations of spatial and temporal filters using statistical 
information of several frames of image for achieving sub- 
stantial enhancement of signal to noise ratio has not been 
Mmeperced before. This thesis investigates a special type of 
multiple frame processing consisting of sequential applica- 
NOE a Spatial filter followed by a temporal filter using 
Several frames. It is shown analytically that the clutter 
BuEMSEession of the spatial filter and of the temporal filter 
are multiplicative (or additive, if they are expressed in 
Ems of db). 

EN UJapter V, the thresholding problem for initialization 
EN Pet detection is investigated. The concept of thresh- 
Eus for detection has been well developed for radar 
ENems [3]. The extension of the thresholding operation to 
two dimensionai problems has not been extensively investigated for 
meses where the probability density functions are not Gaussian. 
Meenas chapter, a procedure for setting the threshold based 
ου πε assumption ot a Gaussian distribution is applied to 
πατε generated images whose probability density functions 
Meemeatssian. In addition, a new procedure for setting 
EUsShold level based on a constant false alarm rate criterion 


Meenout the assumption of a Gaussian probability density 


function is also developed. 


T9 





παρέες τῇ, the four nonadaptive statistical filters 
EN Uuoped for clutter suppression are combined with thresh- 
olding as the nonadaptive focal plane processing algorithm 
ἡ in this thesis. Their properties and performance 
Meemomantitatively studied by computer simulation using two 
Mees Ot images. The first type consists of computer gener- 
ated images which contain targets and two random noise com- 
memes. One noise component is uncorrelated, or "white" 
wenan noise. The other noise component is correlated, or 
"colored" noise modeled by two Markov processes--first order 
and second order [14,19]. These correlated noises are used 
to simulate background clutter. In these computer generated 
Manes, the statistical properties of the correlated noise 
BEEN wn a priori." The second type of image is a set of 
twenty frames of real world infrared images. Here, correlated 
Meese in both spatial and temporal domains is not known "a 
EM" Practical filter design procedures are developed 
which first "learn" the statistics from the real world image, 
then design a filter using the techniques developed in Chapters 
III and IV. Using single frames of these real world images, 
Ter suppression of up to 27 db has been achieved bv spatial 
filtering alone. Using five frames, clutter suppression of 
üp το 37 db has been achieved by sequential spatial-temporal 
filters. These large clutter suppression values based on 


Computer simulated tests on real world infrared images are 





πο important testimony of the practical usefulness of 
ισα focal plane processing algorithms developed 
Mies thesis. 

Mamehapters Vil and VIII, adaptive design procedures are 
EE cs to further extend the concept of clutter suppression 
END s:he nonrecursive spatial filter. No "a priori" knowledge 
ENS statistical properties of the clutter is needed to 
design the filter. The adaptive procedure automatically 
corrects the filter coefficients iteratively toward the 
mal values to yield the minimum error between the target 
Nate and a selected desired response. The concept of one 
mensional adaptive filters based on the least mean square 
Meee criterion has been very well developed by Widrow, McCool, 
EU 270-72]. This thesis extends the basic concept to two 
ExuUuenszons and also develops the following new techniques to 
Eve the performance of the adaptive spatial filter: 

IL Derivation of desired responses corresponding to 
Baus types of targets of interest. 

η... automatic gain control” procedure which vields 
πο απ Misadjustment for varying statistical properties of 
M@emeclutter, prevents overflow and assures adaptive conver- 
ence . 

& Dividing an image into small subimage zones to carry 
Mecer adaptations if the statistical properties of the 


Mage are both nonstationary" and unknown a priori. 


2l 





Simulation results are given in both Chapters VII and 
NEN hich demonstrate the efficacy of the proposed design 
Procedures. 

Chapter IX contains a summary of the results developed 


NAS thesis and conclusions. 


bu 
by 





INN BASTE CONCEPT AND PROCEDURES OF NONRECURSIVE 
So PEO CAL PLANE PROCESSING 
A. INTRODUCTION 

Aca l plane processing has a wide range of objectives 
IAS Optical filtering, sensing, multiplexing, signal 
meeting, background clutter suppression, thresholding, 
En tracking, target discrimination, target recognition, 
Envy others. This thesis is only concerned with back- 
meomme Clutter suppression and thresholding. They are two 
Old problems taking on new urgency and demanding requirements 
IO the recent developments of "mosaic focal plane arrays" 
EN smart sensors." 

Ene-thresholding process is not significantly different 
from that developed for radar. However, clutter suppression 
E crrthms will be drastically different from those developed 
eadar and for old infrared systems using only a small 
number of detectors. New focal plane processing techniques 
ENbDle of suppressing clutter bv several ten's of db's are 
urgently needed to meet demanding requirements of new sur- 
veillance and guidance systems. 

Te nonrecursive statistical focal plane processing 
ENcorrthms are developed in this thesis for clutter suppression. 
mese are ΙΙ. a thresholding step to initiate the 


et detection process. Although differing in detailed 





MEpNenentatyion, they share the same basic concept and filter 
meur ations. The main difference lies in the design of 
heir filter coefficients. They will be presented in this 
5. An appreciation of the common underlying concept 
Wall help to place in proper-perspective the detailed devel- 
ο πι Of all five statistical filters in the following 
miapLers. 
EE IC CONCEPT OF NONRECURSIVE STATISTICAL 

EE: FOR CLUTTER SUPPRESSION 

ο ος the major objectives of focal plane processing 
π Oped in this thesis is background clutter suppression. 
In feared πο ο το τοῦ Όλα array systems, Clutter origin- 
ates from thermal radiations in the background scene in the 
Ereid of view of the sensor system. Since the background 
scene has well defined spatial shapes and temperature distri- 
butions, the background clutter noise in the image must have 
Memeecetined spatial shapes or structures also which may be 
M@emceminated by scattering through the atmosphere, distortion 
ΠΠ the optical and electronic components, and different 
meses sOUrces. In other words, the clutter noise is a random 
Signal with well defined spatial structure for a given scene. 
This intormation on the clutter noise is useful in helping to 
achieve its suppression. However, the important concept of 
Mes tatistical filter is the assertion that although the 
Ea structure of the background clutter varies with the 


Meee, the statistical characteristics of the spatial structure 





Es larse area may be described by well defined statis- 
uL characterizations such as the correlation matrix, 
autocorrelation function or power spectral density. If this 
is true, a spatial filter can be designed to use the signals 
na. | selected pixel or over its neighborhood to process 
Mies tonal at that pixel. Since background clutter has well 
emed statistical spatial behavior while the target of 
te Test only dwells in one pixel, or several pixels of well 
defined location, signals in the neighborhood can be properly 
used to suppress the spatiallv related background clutter and 
NUSCraise the target signal out of the clutter. This is the 
MESE concept of the statistical spatial filter for clutter 
Eunpression. The filter can be designed by performing a 
w tical estimation of the target signal, using one of 
Mer iteria. They will be explained in a later section. 

M@ewstatistical correlation concept in the spatial domain 
ENNDe extended to the temporal domain also. If successive 
frames of images are fairly well registered, with small amounts 
of drift and jitter in between frames, it is reasonable to 
Memeenr that the signals are correlated in temporal domain. 
If this is true, a temporal filter can be designed that will 
Ere sipcnals at the same pixel location of successive frames 
of images to process the signal at one of the frames for sup- 
pression of the temporally correlated clutter. 

In summary, if background clutter sources are related 


(in the statistical sense) either spatially in a single frame 





Or temporally over seyeral frames, signals in both the spatial 
and temporal neighborhood can be used together to process the 
ema at the selected pixel for suppressing the clutter. 
Ir Xunprocessed signals are multiplied by the filter coef- 
ficients and summed together to provide the processed signal 
Mae. selected pixel. Therefore, it is a "nonrecursive" 

uu cr operation. The filter configuration will be described 


ee following section. 


CONE IGURATION OF NONRECURSIVE FILTERS 
I. Nonadaptive Nonrecursive Filters 

In the previous section, the concept of nonrecursive 
enering using unprocessed signals in the neighborhood around 
xel, to be called the "estimation pixel," was 
reduced. The purpose of such a filter is to suppress the 
E creund clutter by performing a statistical estimation of 
Marcet signal at that pixel. The neighborhood area where 
EN Itering is carried out is called the "search box." The 
[oeation of the "estimation pixel" is usually inside the 
Meee OX but can also be outside. For symmetrical clutter 
EUscteristics, it is best to have the "estimation pixel" in 
the middle of the search box. However, it must be moved 
toward the edges of the search box when the estimation pixel 
is located at the edge of an image because there is no signal 


outside the image. 





In summary, unprocessed signals in a search box are 
Memeo process the signal at only one "estimation pixel" 
inside the search box. The estimation pixel is then scanned 
E bout the image. This filter configuration is further 
i bed in two cases shown in Fig. 2-1 and 2-2 for a spatial 


filter and a spatial-temporal filter respectively. 


D 
Met = Spa cessed signal = si * ν᾿ ο) 
τὸ ms ο ο 
ο ο σου ο interest = (S. S5 S. ο» δτ] (2-2) 
η ο ο ls I 
yi = sum of all noise components including (2-3) 
uncorrelates 'white'" noise and 
eouretared 'colored' noise = 
He ae 
ir. τ 
τ, τ-ιΙ-..::..1 and Ll is the total number 


ΠΕ Sime tie search box. 


Meee Spatial Filter (Fig. 2-1) 

EE recursive spatial filter is described by a set of 
Mibter coefficients, or weighting coefficients, over the area 
η πν.. ΠΠ box.” the set of filter coefficients is repre- 
Bemeed by a vector W. The intensity ot the unprocessed 
Signals mE wcusboOx "represented by the vector X, are 
muUolied by the weighting coerficients, (the vector "W'") corre- 
Esto the same pixel location in the same search box and 
ENumed together to give the output intensity at the estimation 
ESI. y, that is, 

y = ο. 
ου... 5σςοςειςιεπες are designed by different criteria to 


Memcescribed in the following section. Spatial-filtering using 
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Figure 2-1 Configuration of Nonadaptive Two Dimensional 
Menrecurs ive Spatial Filter 
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EDEN carch box will yield a processed signal, called the 
Memeemiacion signal!’ of only one pixel, the "estimation pixel." 
NIE Ssrch box is then moved, following the scanning of the 
E umation pixel" throughout the image. 

NEU thesis concentrates on a search box size of 3 by 5 
EN c Iherefore, nine £ilter coefficients are required. 
EN crmatron pixel is usually the center pixel. It is moved 
memes Middle of one edge or one corner sometimes, as explained 


above. 


EE spatral-Temporal rilter (Fig. 2-2) 

Ew cneral, a three dimensional nonrecursive filter is 
EE Ubed by a set of filter coefficients, W, over the volume 
Ew search box" which consists ot several frames of a two 
Mememstonal box. For example, in a 3x3x5 search box, a 3x3 
ΠΝ. DOX 1S used in five successive frames of the image. 
EE sether, W consists of 45 coefficients. However, the 
EMEN temporal filters developed in this thesis are the 
Bear case which consists of sequentially applying a spatial 
EN PET. first on one frame of image, then followed bv a tempo- 
E:ilter, Nw Ον, ver successive trames oT images. 
Mi samp le, consider a sequential 5x5 spatial filter followed 
Me Erame temporal filter. The spatial filter is imple- 
ΠΝ... 115 same procedure described in Case I. For the 
eve frame temporal filter, signals at the same pixel location 


from five successive frames are multiplied by the temporal 
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Figure 2-2 Configuration of Nonadaptive Three Dimensional 
MNODrecursive 5equential Spatial-Temporal Filter 
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filter coefficients and summed together. Therefore, instead 
of 45 filter coefficients for the general three dimensional 
filters, the sequential spatial-temporal filters have only 
Eu uter coefficients. The first nine coefficients are for 
ENSpatial filter. The last five coefficients are for the 
five frame temporal filter. 
EN daptive Nonrecursive Filters (Fig. 2-5) 

ο τους thesis, only an adaptive spatial filter is 
ΙΝ... -ὰ. Its configuration is an extension of the spatial 
EU." configuration shown in Fig. 2-1. The concept of adap- 
tation is based on the one dimensional adaptive filter orig- 
inally developed by B. Widrow [20,21,22]. 

In the adaptive filter, there is an automatic correc- 
NE UEDrocedure for adapting the filter coefficients by using 
EE Sdback loop shown in Fig. 2-3. The search box and oper- 
Memo OL an adaptive spatial filter are still the same as that 
BEcthe nonadaptive spatial filter. However, the output of 
Mies spatial filter is now Compared with a desired reference 
sonal, E Dau uberaertron Operation. The error of this 
Euoarison is multiplied by an adaptive loop gain, u, and the 
Ec cessed signal at a pixel to yield a correction term for 
ELM ter coefficient corresponding to that pixel. This 
adaptive correction is carried out by scanning the search 
box over an “adaptation area." Therefore, in the adaptive 
Filter case there are three image areas: 


The given image area, 
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NE xut iNssr area - search box area, 
livemdedptaeron drea - which is in general 
larger than the search box area; for example, 
OO as ea ren box of 3x3. 
ΟΕ OF STATISTICAL FILTER DESIGN 
section €, configurations of all five statistical 
filters are shown in three different types: Figures 2-1, 
End 2-3. The common principle behind them is to "sum" 
the "weighted'" signals in the neighborhood of the "estimation 
IS”. The neighborhood is defined in a general sense to 
Ede both spatial neighborhood and temporal neighborhood. 
Once the configuration is chosen, the only parameters remain- 
BONO describe the filter are the weighting coefficients. 
They are designed by several different criteria. 
wo criteria are used in this thesis. 
EN Ur)terion T - Minimization of Mean Square Error 
mies "Griterion, a desired result is selected. For 
Bemple, in the nonadaptive spatial filter case, the objective 
Of spatial filtering is to estimate the target,s. However, 


EENo'Utput of the filter only provides an estimate of the 


ΗΝ... --:- Therefore, there is an error, e = 5 - s. Its 
à T 

Ms quare value is Ele ). The filter coefficients, W, are 

designed by minimization of the mean squared error. This 


ου ο 1S Called "spatial MMSE" filter or "spatial Wiener 
Mater” [14,18,23,24,25,26]. 
Peesimilar procedure is developed for the temporal 


MMSE filter and the spatial-temporal MMSE filter. 


C1 
οι 





octet one Maxımızatıon of Signal to Noise Ratio 


πο I ee 


In this criterion, the objective is to maximize the 
Mc signal to noise ratio. The filter designed by this 
REN "on is called the "spatial matched filter." 
A similar procedure is developed for the temporal 

Meeeemed tilter and the spatial-temporal matched filter. 
GES USED IN ANALYZING AND TESTING OF THE 

ο το FOCAL PLANE PROCESSING 

Two dimensional infrared images containing a background 
EE und different targets have been collected in the past 
EE cunfrared scanners and radiometers. Although they 
provide some information on the background and target, they 
are found inadequate because these instruments typically use only 
a few detectors. They are scanning instruments with relatively 
large instantaneous fields of view and fairly broad spectral 
menos. Many of them are not in spectral bands suitable for 
tarset detection in the new surveillance systems. Therefore, 
there is an acute lack of standard background scenes needed 
tor developing and testing new focal plane processing algor- 
mets) tO be used in these new high performance surveillance 
and guidance systems using smart sensors. 

In this thesis, a set of real world infrared images of 
Ep frames with relative drift of 10% pixel each frame, 


2 
memectecd by a responsible agency, was made available. 





Mc Entes inger, Aerospace Corporation., private 
communication. 





NU are used extensively in testing both the spatial filters 
Enspatial-temporal filters. The performance results are 
Ares most Convincing evidence of the usefulness of this research 
Meecause the test is based on real world infrared images. 

EX ver, το carry out detailed research of this statis- 
tical focal plane processing, a wide variety of images with 
Marrying parameters is needed. Since there is simply no such 
supply of real world images taken by the new mosaic focal 
EU ues. it was necessary to develop a theoretical model for 
m@emoackcround clutter. If it can be proven valid, different 
Ἱ. -Ίπασες can be generated on a computer readily by simply 
Wecying the appropriate parameters. 

For this purpose, contaminated images have been generated 
by using the following models. A contaminated image consists 
of three components. 

A Target 


It 2s described by its spatial shape, its movement 


EE cen frames and its intensity. The intensity is described 
Eher deterministically by S, as defined by eq. 2-2, 
Siestatistically by a mean Hr and varıance στ" 
me Random Noise 
here are two types. The first type is Gaussian un- 
correlated, or 'white" noise described by its mean "UN and 
variance E The second type is Gaussian correlated, or 


"colored" noise - modeled by two Markov processes [Appendix A]. 





mei first order Markov process described by its auto- 


morcelation function. 


Zoe n 

BE. SON 2 EM 

where σαν " variance 
Oy 7 konrizontalweorrelation factor 
Oy 3 Wogekedieeorrelation factor 
n —5 horizontal coordinate of image 
nuc Icalscoordjg)ndte or image. 
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w ec cond order Markov process described by its auto- 


Ecrrelation function. 


NE m) Im, 
R = Toy Py Oy «05 (Αμ) cos (Syn) 


where horizontal spatial frequency 


Pu 


By = vertical spatial frequency. 





ES SINGLE FRAME FOCAL PLANE PROCESSING FOR 
BER UBERESSTON - NONRECURSIVE STATISTICAL 
SPATIAL FILTERS 
A. INTRODUCTION 

Meis chapter, two statistical spatial filters which 
use only one frame of an image are developed. One is designed 
EN u:m)zing a mean square error criterion. This type of 
filter is called "MMSE" filter, which is more commonly known 
as a Wiener filter. It provides an "optimal" estimate of the 
ες Signal and will be developed in Section C. The second 
emes designed by maximizing the output signal to noise 
ratio criterion and is commonly known as the matched filter. 
NEN! be developed in Section D. 

ο το two statistical design procedures can be equally 
Well applied to focal plane processing using several frames 
of images in the form of three dimensional spatial-temporal 
or temporal-spatial filters. They will be developed in the 
Ec chapter. 

ene Spatial filters developed in this chapter and 
Mies patial-temporal filters developed in the next chapter 
Will be evaluated by using two types of images. One type is 
computer generated images containing correlated noise modeled 
EN Markov process to simulate background clutter. The other 
meme is a real world infrared image. The results from both 
Simulated and real world scenes are presented together in 
Enspter VI. 

T 





B. CONFIGURATION OF TWO DIMENSIONAL 
ESURECURSIVE SPATIAL FILTERS 


Peeehough the design criteria of two statistical spatial 
EN developed in this chapter are different, they share 
Hu ESume filter configurations as shown in Fig. 3-1. There- 
E the filter configuration and operation procedure will 
be described before their individual design criteria are 
Bresented in the next two sections. 

In these spatial filters, signals in the neighborhood 
EN selected pixel of interest are used together to help the 
E cssiung of signals at that pixel. The selected neighbor- 
E uS called a "search box." .As explained in Chapter II 
Me previous section, the objective is to suppress the 
Ecreund clutter by performing an estimation of the target 
Bear at that pixel, using its neighborhing signals and the 
EM Uedce of their statistical spatial correlation properties. 
ENS Carried out by designing a set of weighting coefficients, 
πμ, 165: coefficients, W. For every pixel in the search box, 
EE sehting coefficient is assigned. Signals of all pixels, 
NE UUthe search box are multiplied by their corresponding 
Meter coefficients, W, and summed together to give an "optimal" 
Mate Ot the target intensity at the "estimation pixel," 
Euch can be anywhere inside the search box. It could also 
Bewtocated outside the search box although this is not devel- 
Econ this thesis. In general, the location of the "esti- 


Eon pixel" is in, or close to, the middle of the search box 
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Pigure 3-1 Configuration of Nonadaptive Two Dimensional 
NOMPeGUmSi Ve spatial Filter 





because common sense suggested that spatial behaviors in all 
ESctions around the estimation pixel should be used to 
mevea! the spatial behavior of background clutter and to help 
teve their suppression. However, there are situations 
Ere Signals in certain parts of the neighborhood do not 
Bere; for example, when the estimation pixel is located at 
E Nedse of an image. In these cases, it is not possible to 
ED the estimation pixel in the middle of the filter. 
σα, τι must be off to the side, as will be shown later 
several examples. 

Mie” size ana shape of the search box can also vary. Only 
EN shaped search boxes are developed in this thesis be- 
Eause the correlation properties in vertical and horizontal 
ec tions are assumed to be quite close. On the other hand, 
EN ncebpt and design procedure developed in this thesis can 
be easily extended to non-square-shaped search boxes if needed; 
momeexample, if the correlation properties in the vertical 
Sarection are significantly different from those in the 
Ex Zontai direction. 

The size of the search box depends on the correlation 
Meoperty of the background clutter and on the size of the 
EU rts Of interest. If the spatial correlation of the clutter 
15 strong, there is no need to go beyond a few neighboring 
ERIS to determine the correlation properties. Therefore, 
MEUS search box is sufficient to accomplish an effective 


E ressrion of background clutter. On the other hand, if 
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Aer spatial correlation ot clutter is weak, one needs further 
Ne 1enboring pixels to obtain the correlation properties 
Meoperly and a larger search box is needed. In this thesis, 
a 3x3 search box is developed almost exclusively because it 
was found that the correlation properties of several real 
world infrared images are quite strong. In terms of a corre- 
Exon factor, on a scale from 0 to 1 corresponding to no 
correlation (white noise) to perfect correlation (determin- 
istic), the real world images examined in this thesis indicated 
range ot values above 0.8. On the other hand, the concept 
and design procedure developed in this thesis can be easily 
extended to large sizes such as 4x4, 5x5, etc. 

In summary, nonrecursive spatial filters developed in 
Mmeoechapter consist of a search box for every pixel of in- 
Best in the image, called the "estimation pixel." Because 
secondary signals in the search box are used to estimate the 
Eu ct at the estimation pixel, target estimation pixel 
EN - moved to any part of the image or scanned to cover any 
EN ved corner of the image. In this thesis, a raster scan 
Me estimation pixel is used to cover the whole image. 
ne estimation pixel is at the corner or along the edges 
of the image, it cannot be located in the middle of the search 
box. On the other hand, whenever possible it will be located 
whe center. For every search box, signals of all pixels 
are weighted and summed to give an estimate of the target 


intensity at only one pixel inside the box, the estimation pixel. 
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Maeeweighting coefficients are designed using different 
criteria. Two of these design procedures are presented in 


the next two sections. 


... NONRECURSIVE SPATIAL MMSE FILTER 
principle or Optimal Estimation 

Me Objective of the spatial MMSE filter is to give 
a processed signal Y = £y (m, ,n.) which will be the "optimal" 
estimate of the target of interest, S = Eg (mn) where 
(m. , n.) are the indices of the estimation pixel. The cri- 
E usn for "optimality" is the "minimum mean square error" 
(MMSE), sometimes known as the Wiener filter. The theoretical 
derivation of the MMSE filter is well known and more detailed 
information can be found in the following references: 


ENererence 18 states the general MMSE criteria. 


- Reference 25 describes an image restoration technique 
using spatial frequency domain design technique. 


- Reference 24 describes an image enhancement technique 
based on the MMSE algorithm using, again, spatial fre- 
quency domain design method, requiring efficient trans- 
mation techniques. 


- Reference 25 describes in detail the spatial domain 
E acon algorithm for the MMSE filter considering 
some implementation methods in the frequency domain. 


- Reference 26 describes the linear algebraic image restor- 
ation method in general, and the least squares technique 
mieluding the Wiener filter formulation in particular. 
Me design equations, both in spatial and spatial fre- 
quency domain, are presented. 
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οι ο ος ος οἳ implementation of spatial 
Wiener filter for suppression of correlated noise and enhance- 
ment of point and line target was suggested in Ref. 14. This 
design method will be further extended here and in Chapter IV, 
which presents multiple plane spatial temporal filtering. 


NL EUesipen procedure is presented in the following paragraphs. 


[Step I] Description of Unprocessed Image: 
The unprocessed signal of the whole image X is given 


EN τυ dimensional array shown in Fig. 3-2(a). 


ENT E iin 
D 
τ. m *MMAX 2 =S + N 
(ser) 
x M 
1 NMAX MMAX, NMAX 

gere X = intensity of unprocessed signal {1153} 

T target signal of interest aoc D 

N = sum of all noise sources οσοι 


MMAX - number of horizontal pixels in the image 


NMAX - number of vertical pixels in the image. 


The original signals inside the spatial filter search box are 


given by a smaller two dimensional array. 


*m,n Satin  ° ‘ * *m+MSB,n 
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IAEA ACES CONE TGURATION 


ene =a Sm 
+ N(m,n) 


NMAX , 
Image Size 


(MMAX = NMAX) 


Eure 5-2(a) 
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Pigure 5-2(a) Coordinate System for the Image 
a MESUUPDOTISLte System for the Spatial Filter 
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pere πο ο ου μοι κο number of the upper left 
Bm Lore search box 


ase number of the upper left 
Connie eor athe search box 


Asno zontal size of the search box 
ο ert a al eize of the search box. 
wens thesis, a new search box coordinate system is 
Msed for pixels inside the search box. They are referenced 
w espect to the upper left corner pixel (m,n) and described, 


mewn in Fig. 3-2(b) by 


ο... XMSB 
E a X 2MSB 
ο 
_ *MSB- NSB 


'... ἐπ dimensional array is further simplified by using a 


ome dimensional vector representation. 


T D --- 
X = [xy Xp Xi Xz] [oci 
Ere i = MSB- (An-1) + Απ 
e Ms liue ο να οχι ocCation im search box with 
respect to top row 
icc Uc Pc location im search box with 


respect to left-most column 


Pai cot anumben of pixels in the 
search box 


oeste ot the spatial MMSE filter is to give the 
EEUU estimate of the target signal of interest at the esti- 
mation pixel (MES,NES) by summing all weighted signals in the 
Een box. (MES,NES) is the location in the search box coordi- 
Me system. In the one dimensional vector representation, the 


weighting coefficients are also described by a vector W as shown in Fig. 3-2(c). 
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T 1.1 
W u E ae Wr] "LT 
where Weg = ο kine mele de) tne estimation pixel 
(Ese NES) = 


EDO] Filtered Image and Mean Square Error: 


ine output of the filter is: 
D Wo 5 (52550) 


where ee] estimate of the ΤΠΕ ἐπε estimation 
πο NEST NESI: 


Let us define the estimation error as 


e(MES,NES) = s(MES,NES) - S(MES,NES) Gece) 
mean square error is then the expectation value 
Elle- (MES, NES)] = E((s(MES,NES) - $(MES,NES)]} 
EE ES ERE S CERS 


[Step III] Minimization of Mean Square Errors: 
Eee a a is differentiated with respect 


EN and is then equated to zero. 


Bf oto? [sas Alas) ο 0 


2 a 
a E[e“(MES,NES)] 


ο του - Ὁ EA 


Equation (3-3.9) shows that the estimation error is orthogonal 
EN C-unprocessed signal X. Further simplification of (3-5.9) 
gives: 


ΙΗ ES = Eiko WI S EIX-XI1*W eon) 


merch is the equation for designing the filter coefficient W. 
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Let us define 


D 
BZ ZEr 23 (MES.NES)] i 3 IT) 
ono meomrLectarlon between the unprocessed 
image signal X and the target signal of 
interest. 
E(x] xı) E(x, x5) E gr E(x, xr) 
T 
Ryy = E[X-X ] = E(x5 x1) E(x, x5) SE E(x5 xi) 
Es, E(x; Xy) 
2) 


- correlation matrix of the unprocessed 
image signal. 


᾽ν... IV] Equation of Filter Design: 


Pouatıon(>-53.10) 15 now expressed as: 


Or 


zo) 


PER 
C1 





It is a set of I simultaneous linear equations used 
ENojve for the weighting coefficients, or filter coeffi- 
πε, οἳ the two. dimensional spatial MMSE filter for target 
EEumation. 

many practical applications, we assume that the 
Meet signal S and the noise N are uncorrelated. lí we 


Mer assume that the mean of the noise is zero, then 
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Ryy = Ros + RNN m 
where Res 7 once latıom maerıx ot the target signal 

Raw 7 ο απ απο παρα of the noise. 

i 


The filter coefficients (3-3.13) are given by: 


1555.75) 





EMEN bscript WF stands for 'Wiener Filter." 


2. Design Procedure for Spatial MMSE Filter (Ref. 1] 


itemcestem a spatial MMSE filter, a three step procedure 
EN d. The first step is to calculate the statistical proper- 
we οὲ ἴπε ἴατσεῖς Ros A πο οςεοπα το 15 το Calculate 
ENEEStatistical property of the background clutter noise RAN" 
Meast step is to calculate the filter coefficients by 
νι. .(5-5.15). They will be explained in more detail in the 
I Towing. 


ENXCOUI] Calculations of Statistical Properties of the Targets 
Ros La] 


ime. Calculation of Ros and P are relatively straight- 
forward. They depend on the type of target signal. Once the 
target signal of interest is given, as shown by several 
Seamples Of point target and line targets in Fig. 3-3, 


Ros Aida? are Calculated by the following expressions: 
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Marcet Required m Required Target Required 
Location with ᾿ Location with Location with 
Respect to the Respect to the Respect to the 
Searcn Box in Search Box in Searcn Box in 
Γι». 5-54]. Bias O ze ν, ο ώς 
(α) Examples of|Line Targets Relative Required Location 
35s. 5. (b a € 

g 
L| 
(d) (e ) ({) (4) (e) {ΠῚ (6) (e) (1) 
(g) (h) (i) (9) (h) T (9) (h) a 
E | CORE 
mil E 
Eur. 3-3.7 o Vo | Fig. 3-309 


some. target configuration with respect to search box 


Figure 5 Examples of Different Estimation Pixel Locations 
ana Dirferent Target Types 
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Els] 31) Είδη 52) 2. Bs So) 


Ros = E(s5 $1) E(s, $5) AA E(s, Sy) (3-35-16) 


E(Sg 51) a E(Sg Sg) 


E(s, X1) E(s;, 5 


P = πέσο κ.) Ξ Den 


es Sy E(s, s 





Notice that Sc 1s the signal at the E.P. for a 3x3 search box. 


lu uocecuat cases writ be presented. The first case 
END NDojnt targets and for a central estimation pixel. 


Under those conditions, x επ“ πι other S's are zero, 


oe 10 
0 0 0 
0 

Reg = | 0 E (3-3.18) 
0 e 
0 
0 
0 | 
0 0 0 0 
0 
0 
0 

5 

τα 
0 
à (3-3.19) 
0 
0 


op 





EN UT = intensity. of the point target. 

lncosecond casecrs tor a horizontal line target, as 
In Fig. 3-3.7(a), and for a central estimation pixel. 
Under these conditions, S4» Sc and sg are not zero; all other 


EE are zero. 


ου Ὁὂ 0 0 0 (Elze) 
0 0 
0 0 
0 E(s,s,JE(s4sc)E(s,sg) ιν; 7 
nae = 10 E(sgS4)E(s5Ss)E(S:5Sg) 0 
0 E(scs,)E(sgssc)E(sgsg) 0 
0 0 
0 0 
οὐ 0 0 0 0 9 0 
0 
0 
0 
Pp = E(s,;s,) ο ον. 
BE (3-5-21) 
E(S¿Sg) 
0 
0 
2 


iiemanplitide of the line target s,, Sc, Sg Can be 
Becher deterministic or statistical. In many applications, a 
deterministic target amplitude is considered. If the interest 
monly in the location of the targets, Ss, =So=S¢ = constant. 
If the amplitude of the target signal is known, S4» Sc» and 56 


δε Proportional to its spatial variations. 





EM UUsStical amplitudes are useful in cases where a large 
Member Of targets are expected and their amplitudes are 
Meseriped statistically, for example, by a probability 
density function. This problem will be discussed further 
ρε V where a target detection procedure is devel- 
oped. 

Other types of targets can be handled in a similar 


Manner. 


MED TI] Calculation of Ray! 

Il rccecusrses are used in this thesis to calculate 
Mm@emcOVariance matrix of the background clutter noise, 
depending on the type of images used in the analysis. 

Ἱ. Computer Generated Images: 

iis assumed that background clutters in real 
Mierared images can be modeled by Markov processes. Their 
autocorrelation functions can be described by the following 


closed-form mathematical expressions: 


ου order Markov process: 
= 2o n I1 
Q (m, n) ο en Pry | Oy | & ΠΗ 


Second order Markov process: 


ty 
un 
I 


em,n) = Sex oj oy" | cos (8m) COS (Syn) os 5v 


u 


where Ton variance of correlated noise which is used 
to model the clutter. 


πι τοπ ο] correlation coefficient between 
two adjacent pixels. 








ιν... ncc correlation coefficient between two 


ae pels. 

cu a horizontal spatial frequency (for 2nd 
order Markov process) 

Αν = wp = vertical za alas eanemey. (tor 2nd order 


Markov process) 


These two dimensional correlated random noise sources 
EUNbe simulated by a recursive procedure described in Appendix 
Esto generate simulated background clutter images. For these 
images, Ry, can be calculated easily [14]. 

2. Real World Infrared Image: 

real world intrared images are given, their sta- 
EE 7 characteristics must be calculated directly from the 
Een images, using eq. (5-35.12) and then averaging it over a 
ΝΠ... number of pixels to obtain its expected value. It must 
be pointed out if the number of targets in the image is high, 
ο --ις amplitudes are high, they will cause error in the 
mememration of the statistical properties of the clutter. 
The analysis of a real world infrared image was made by 


ΠΡ. Hilmers in his thesis research [50]. 


ν..;» [1]. Design of Filter coefficients: 


Pre ne calculations Of Roco, P and Ron, the filter 
ES NN 


Meetricients are designed by solving eq. (3-3.15). 


tre o Merit tor Clutter Suppression - 


MEOGeSSIE Gain 


To evaluate the performance of the designed filter, 


the processing gain (PG) was selected as a figure of merit. 





Me PG definition is: 


eaae NOn e pawer) At filter output 
CG = men nn nn 22 
eron δις power) At filter input 


ο ο οὐ] 
The PG is given by the following equations: 


input signal power at a given pixel * s = Po 
! : i D 2 2s 
Input noise power at a given pixel = Oy +UN= Py 
L [NIS 
i 
o 15 nose variance, defined by (3-3.22) 
Uy is noise mean 
: το) 
Output signal power at estimation pixel = (SW)” = Ps 
i O 


where 3° was defined by eq. (2-2) and w by eq. (3-3.5). 


Output noise power at estimation pixel = 


T a 1T Dm 


EL(NI-w)^] « Eg(wI-N-Niw] » wl-EpN-N!]-W =W Ray W = Py 


where R defined oy (525,15). 


NN 


Therefore, the PG is: 


(Ps /Py > SO RA 


_ N 
1° πο τοι ορ c 
where. ON and Uy Were presented im Section II.E.2. 


PG = (3-5.24) 


E UG point target and zero mean noise, the PG will become: 


2 Le 2 T O 3 PA 
το ο ο σι RoW Ww MES, NES) 
ου ο CO 
S / (ow ) W "Buy Y 
SO) 
where R > Ken " and MIESANES ) is the filter 
NN N NN ; 


B@erricient at the estimation pixel. 





Results ot Computer Simulation 


Properties tot nonrecursive spatial MMSE filters 
M@emeneir performances in clutter suppression and target 
detection, when combined with the thresholding process, are 
investigated by computer simulation. Two types of images 
were used. One is a computer generated image containing 
EE correlated noise represented by Markov models to 
Samimbate background clutter. The other is a real world 
infrared image. 

τητος Size 15 limited to a 3x5 Square. 
Mut targets are used in most of the computer simulation. 
Μπ... "nation pixel is usually in the center of the 5x5 box. 
Mmemis moved to the side of the 5x3 only when the estimation 
Meer 1S along the edges of the image. 

lig -rusatronoot the filters 1s carried out over a 


Mine of input conditions: 


SNRI Input power signal to noise ratio 
οἱ ο το di 


22:0 9d3c00meractor - 0.999 fo.0.4. 


Merectarget detection, a probability of false alarm (Pra) Γη 


|l to 107? is selected as a parameter. 


mie range of 10 
The computer simulation results are presented in 
Chapter VI where both single frame spatial filter results and 


muitiple frame spatial-temporal filter results are presented 


Beecther. Two types of presentations are used. The first 
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EE NUS quantitative and does not use two dimensional pic- 
memes, Filter properties such as filter coefficients will 

be presented as functions of input signal to noise ratio and 
EE Nation factor. Filter performance, such as processing 
EE Cr clutter suppression and probability of detection 
mepetarget detection, is related to input signal to noise 
Mo while the correlation factor and probability of false 
alarm are selected as parameters. The second type of presen- 
Memon s pictorial and uses two dimensional images. Computer 
wS using nine gray levels are used to present the 
Messed image, processed image after the application of 
wa filter and images after further processing by thresh- 


dino. 


See yNONRECURSIVE SPATIAL MATCHED FILTERS 
EN rinciple of Maximizing Signal to Noise Ratio [Ref. 27-29] 
The objective of the spatial matched filter is to give 
a processed signal, Y - £y (m. ,n.) which will provide the max- 
ENUSOutput target signal to total noise ratio. The filter 
design procedure is presented in the following paragraphs and 
is an extension to two dimensions based on the theoretical 


Semivation of Appelbaum [29]. 


Step I] Unprocessed Image: 

The configuration of the nonrecursive spatial matched 
filter is the same as that of the MMSE filter. The description 
of unprocessed image and filters is the same also as presented 


En Section B.l. 


S 





| 


EX 


X SF N 


Mier tcilter is described 


| X1] I 
(3-4.2) 

ο 

wr] (3-4.3) 


Beep 11] Filtered Image and Output Signal to Noise Ratio: 


Mie output ot the filter is 


T 


y cene κ 
y contains two componen 
y = ye " Mis 
where Vo = output 
Vy = output 


maenoutput signal power 


the expected value of | 


n 


E Usuperscript * refer 
ENDperscripted variable 


where Ra 1s the 
E(N, 
] E EN, 

NN : 
E 


P = Pigs ] 


[540 4) 
TS. 
ES) 
csi - 
Siomaleveltage = 5 W (3-4.6) 
ce ea = 
noise voltage = N .W (9-4.7) 
2 
5 Dar: The output noise power is 
2, 
7 Ἔκ 
1 -ΕΠ|Ν΄.Ν|] - Ε[ΝΝ Ν᾿ w] 
* 
- w^g[N NI ]w 
nen 3-4 
= Ruy * (3-4.8) 


s to the complex conjugate wherever a 
is complex; otherwise the * can be ignored; 


covariance matrix of the noise given by 


Nj)  E(N,N,) . . . E(NyN7) 

N, ) E(N,N,) NR: τ _ 
(5-4.9) 

Nj) - +--+... E(N7Ny) 
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assuming N has a zero mean. The output power signal to noise 
11ο 1S: 
Z 
ve | 
SNR = u (3-4.10) 


out τ. : 
W RAN W 


The matched filter coefficients can be designed by maximizing 


(3-4.10). However, a more effective way to derive the matched 


filter design equation is to diagonalize the matrix Run 


Step III] Diagonalize Output Signal to Noise Ratio: 
Let A = the linear unitary transformation which 


Giagonalizes the matrix R which 1s equivalent to decorre- 


NN 


meneame the input clutter noise, i.e., 


r zt me er 
* = = e «ν - 
A RA I and Run (A *A*) (3-4.11) 
.. εν filter configuration is shown in Fig. 3-4. „The 


Mesuitant transformed input signal and noise are: 
Ss’ = A+5 7» 


NU 


ASN On) 


EN be the new transformed filter, then the output signal 


and noise voltages are 


να - Ν'ἷ.5! - μι΄.Α.8 (3-4.14) 

Vy = WeosNt = w'!-Aen C NIS 
Comparison of (3-4.13) and (3-4.14) with (3-4.6) and (3-4.7), 
the relation between W and W' can be found as 

SEU τοὶ 





X=5+N 
fno On: 


| 
Original 
filter 
configuration 
W | 


=== | 

| 
Trans formed 
DNE Eo | 
configuration 





| 
| 
| 
| 
| 
| 
| 
| 


προς NES) 


Eure 5-4 Original and Transformed Filter Con- 
aon Ued in the Derivation of 
ο απο πλακα Filter Design Equation 
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The output noise power after the transformation is 


ΒΗ! '.Νι| 5] E Etwrtiyrs NI 


πα 
u 


W'] 


wistepnre net 


) w' Guia) 


Since the transformation .A diagonalized the EAN and decorrelates 
Bue noise 
E[N'sIg'] = 1 ο... 


and 


P o= wislw: ES 


The output signal power after the transformation is 


> 
= t E: des ? 
Po [Va | Dear) 
Mmererore, the output signal to noise ratio is 
i 
Iva | 
SNR = (554.21) 


(I W! κ μι 


ESSD CIV] Equation of Matched Filter Design: 
Mieres en tfequation for the spatial matched filter 


is obtained by finding the maximum value for (SNR) To 


out 


olish this, the Cauchy Schwarz inequality is applied to 


ES. 1). 
vgl? & pw [7515 (3-4.22) 
where Iw] = waly (imt. 25) 
|s'|* - Ιω... (5-4. 24) 
2. (SNR) ur E... Be 0524025) 
W'# W! 
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Therefore, the maximum output SNR is 


(SNR), * |S'|* SS 


It will be shown in the following that the special 


ml ter 
E Br) 
where c = an arbitrarily selected constant 
will provide the maximum IA LO ro se 
- Ter z (12 
HS esM M cle 
ο ο 
puce 
2 
SNR NES lig s ium 
(SNR) out 7 p. BN cr 
Mites τε has been shown that the special filter, W' = cS', 


Ehe matched filter after the transformation of A. The 
Eched filter itself is expressed by: 


T 


D a ange 


= ' 
NE AW 


T 


A 


me 


Meee the definition of (3-4.11) 


(3-4.28) 





This is the design equation for the nonrecursive spatial matched 
mercer. Using this matched filter, the maximum signal to 


Bose ratio is: 


= * e 2 
SNR ax S RYN S (3-4.29) 
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EN worthwhile to note that the maximum output signal to 
noise ratio depends only on the target signal and clutter 
Bee characteristics. In active systems, such as radar and 
communication systems, the signals can be designed to yield 
Ex b5rIsh SNR. On the other hand, in passive systems, such 
Mme aosiVe infrared and optical surveillance systems, the 
Em -σπα| σᾶη ποῖ be designed. The maximum SNR is given 
w5 4.29). 
fee Design Procedure of Spatial Matched Filter 

To design a nonrecursive spatial matched filter, a 
procedure somewhat similar to that of the nonrecursive spatial 
EE NM Iter is used. This is readily clear by comparing their 


Meson equations. 


- 1 
Bor MMSE filter: W UC INE NOR) P ος το 
(Wiener filter) us iB >> 
Bor matched filter: Wwe = dM: i (20023) 


ENhree step procedure is also used. 


END I] Selection of c and Calculation of S*: 

Although the selection of c is arbitrary from the 
ME UPornt otf matched filter design, its selection is important 
Since its value will affect the threshold setting for target 
detection. This will be discussed in more detail in Chapter Vl. 
ws eneral, the value of c is chosen so that the filter 
weent corresponding to the estimation pixel is normal- 


Maca to unity. 





D Υ ιππππος 5715 Υ6Τγ simple. Two examples 
will be given. For a point target as in Fig. 3-3.1. 


sols 1000050 0 ο]. 


Ma horizontal line target as in Fig. 3-3./(8). 


ss so] 


nereo anplitude of target 
Other types of targets can be handled in similar ways. 


Een Il] Calculation of Raw 


This 1s exactly the same as described in section B.2. 
ν᾽. III] Calculation of Filter Coefficients: 

The filter coefficients are calculated by solving 
EuUstson (35-4.28). 


"F. 


m Processing Gain 

The processing gain (PG) of the matched filter is 
derived in a way similar to the derivation in section B.35., 
using equation (3-3.24) as a generalized PG equation. For 
Mepoint target, equation (5-5.25) can be used to determine 
the PG. When the constant c in the matched filter is selected 
ENusscested in D.2., the PG of point target will simply 
become: 

E Tas W 
NN 
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EN point target, assuming noise with zero mean, the P.C. 


Gan be shown to be independent of input SNR. Defining 


D D MMOL EL ET -1 
NS [O 0 .. 1 .. 0] = s 51 and Run =; RuNO and 


σ 
Sa@pstituting these definitions into eq. (3-4.29) yields: 


al -1 
PG = NR (output) s SNR ax E z ST "Ran ST _ 
SNR input) SNR (input) s^ /c* 
i - 1 
S1 Ryno “I 


ΙΝ. last expression of P.G. is independent of signal and 
noise power and depending only on the correlation factor of 
the correlated noise and the target location in the search 
Box. 
Results of Computer Simulation 

Properties of nonrecursive spatial matched filters 
and their performance in clutter suppression and target 
EN cron when combined with the thresholding process were 
EU cunvestigated using computer simulation. 

The items of investigation in terms of search box 
EE background clutter characteristics, target types, filter 
coefficients, performance figures of merits, are the same as 
EN Ses of nonrecursive spatial MMSE filters. They have been 


described in Section C.4. and will not be repeated here. 


E. SUMMARY 
Two types of statistical spatial filters were discussed 


τρις chapter: the spatial MMSE filter and the spatial 


ο 





pushed filter. Both filters offer some signal processing 
advantages. 

The MMSE filter, designed to minimize the mean square 
En w1ll offer the best spatial estimate of a given target. 

w matched filter, designed to maximize output signal to 
noise ratio, will result in the best enhancement of SNR suit- 
able for detection purposes. 

EN rns out that for the detection of a point target, 
both the MMSE and the matched filter offer the same processing 
BuU This will be shown in Chapter VI. 

Mmemceneral, the type of filter to be selected will be 
Meecrmined by the practical processing requirements for a 
given problem. For target enhancement and restoration tech- 
5 which require accurate estimation of the target's snape 
EN Dtensity, the Wiener filter is preferred. For target 
detection requirements which allow distortion of target's 


EE ecand intensity, the matched filter is preferred. 
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mee MULTIPLE FRAMES FOCAL PLANE PROCESSING FOR 
T MON NONRECURSIVE STATISTICAL 
ΤΟΤΕ AND SPATIAL=TEMPORAL FILTERS 
eee LNTRODUCTION 

If an imaging system can be stabilized or tracked to 
follow a scene, several successive frames of images can be 
used for various image processing purposes. Signals from 
Mp le frames ot images can be used in several ways. The 
west way is to use one pixel from each frame; signals 
Of the same pixel from successive frames are used together 
in what amounts to temporal processing. A more involved 
Way is to use several pixels from each frame; for example, 
signals from nine pixels in a 3x3 search box as developed 
chapter III are used together with signals of the same 
Search box location from consecutive frames in what amounts 
Ex ccombined spatial-temporal processing. 

Mts thesis, an intermediate process is developed. A 
Beatial filter is first used to process several successive 
frames of images individually. Then, single pixels from 
seem Of these frames already processed by the spatial filters 
meemusea together to perform a temporal filtering. The 
Beetial filters are designed by statistical criteria as pre- 
enced in Chapter III. The temporal filter will be designed 


in a similar manner, using the same principle - that if the 


temporal noise is correlated, it can be suppressed by a 





nonrecursive temporal filter designed either by a minimiza- 
ED of mean square error criterion or by a maximization of 
Ito noise ratio criterion. The objective of these 
ma Filters is the same as other focal plane processing 
techniques developed in this thesis, namely, signals from 
single frame and/or multiple frames of images are processed 

EN UPpress the background clutter so that weak targets buried 
in them can be pulled above the noise, thus enabling a thresh- 
MO be applied to initiate the target detection process. 

In Section B, a class of nonstatistical, multiple frame 
focal plane processing techniques, called "frame differ- 
encing'" techniques, are first presented. An analysis is then 
Meroe ot their effects on the statistical properties of the 
images. These nonstatistical techniques will be compared with 
the performance of statistical temporal filters developed in 
ENMSCthesis. In Section C, three dimensional statistical 
οὗ using multiple frames of images are developed. Spe- 
Cifically, a sequential combination of several spatial filters 
One temporal filter is developed. In Section D, an accum- 
ENSuIve implementation of the nonrecursive temporal filter is 
Enested which may simplify the memory requirements in hard- 
Ware implementation. In Section E, computer procedures for 
Investigation of these multiple frame, focal plane processing 
algorithms are described for both simulated images with pre- 
Beribed statistical properties and real world images without 


Tori knowledge of their statistical properties. 
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However, the simulated results will not be presented in 
this chapter. They will be presented in Chapter VI, which 
includes the simulated results for both the single frame 
Eust filters and the multiple frame spatial-temporal 


filters. 


NON STATISTICAL TEMPORAL FILTERS - FRAME DIFFERENCING 
I Introduction 

Multiple frame processing has been actively developed 
in the past few years for space surveillance applications, 
ENerally for those systems in which the image sensors 
platform is stabilized to cover the same area for certain 
periods of time. These svstems are generally known as tne 
Bene, or step-staring, systems. In these systems, there 
E csreat deal of correlation of background clutter among 
ED ceutive frames of images. A simple subtraction of two 
NE Uboring frames should eliminate completely, in principle, 
EN Scksround clutter. This is most effective in revealing 
EUe weak targets which are moving and do not dwell in the 
memeepixel between two frames. However, in real world situ- 
Eus: sensor systems cannot be perfectly stabilized. Also, 
EDS background clutter is stationary. An example is 
clouds which move. Consequently, simple subtraction of 
Mo neighboring frames is not adequate in many practical 


applications. More involved subtraction processes using 
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several frames of image have been developed. They are 


Sommoniy known as the '"Frame Differencing" methods [10]. 


"Single Difrerencing' using two frames = 


"Double Differencing'" using three frames: 


DEL '., τ, )e (F,>F,) 


1 3 3 
iu usc Dirterencing" using four frames: 


ec o: 5:5 


= 217 = T 
1 2 3 ο M ee 


4 
iourth Drffterencing'" using five frames: 


DEM EN s E 5 ES ESE) > 


τ 2 4 5 
E - (F,-5F,+5F,-F-) 
where E; refers to the signal from the same pixel from the 
Eh frame. 

These "frame differencing" methods were developed 
from the simple concept that "non-moving" clutter can be 
cancelled out by frame to frame subtraction. The weighting 
factors for individual frames are fixed and are independent 
Ene specific nature of the images. Since the statistical 
Moral filters to be developed in this chapter are designed 
Beine to the specific statistical properties of a given 
Meteot images, a statistical analysis of the standard "frame 
differencing" techniques will be made so that they can be 


Compared with the statistical temporal filters developed in 


mars chapter. 
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Statistical Analysis of First Differencing Technique 
Since the same pixel location is used in "frame 
mmrcerencing’’ techniques, its coordinate (m,n) will not be 
used in the following analysis. Instead, a number k is used 
to REC ibe προ tlh trane- ἵπ τπο following analysis, 


Special attention is given to the jitter problem which is 


modeled by a random noise component from frame to frame, i.e., 


1: = oxf{k) + Bn(0,1) (4-1) 
e necare two constants 
n(0,1) = a Gaussian noise component of zero mean 
and unity variance 
Bk) - background clutter level at a given 
pixel in the k-th frame 
ER cU cubaeksepguud clutter level at that pixel 


Im πε (ktl)-th frame 

Mea. (4-1) it is assumed that the noise intensity at a pixel 
EE CCk-*1) frame is proportional to the intensity in the 
EE rxe!l at frame (k) with proportionally constant a. The 
NEU term in eq. (4-1) represents the noise added to that 
Euxel due to the sensor jitter. 

The constants a,8 can be rewritten in different forms 
memoactble with the notation used in the Markov model in 


Appendix A. 


2 
x (k+1) = oyX CK) * O,¥I-9, “n(0,1) (1-2) 
where * py = temporal correlation factor 
2 
ο ου ος: 


στ. temporal standard deviation. 
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NUNEHDCEEOMOwPRnES T the statistical properties of the 


first differencing method will be derived. 


Met As cd trerenced signal 

AOS US 

= (1-94) x (K) - 0/Tp, e n(091) (4-3) 
Mmeemean of z(k) is zero since x(k) = x(k-1), (4-4) 


Mere the symbol X 15 the expected value of x,E(x), taken 


by averaging over the two dimensional image. The variance 
@eez(k) 15 
2 2 a 
E[z (K)] = E[(1-04) Xx(K) tc DRE (0, 1) 


+ 2 (1-0,)x (9 /1- * n(0, EN 


ΟΝ; 2 2 2 
(1-04) Ty +O, (1-9. or ee Oma Ori constant 


The last term is zero because x(k) and n(0,1) are assumed to 
EEEuncorrelated and since n(0,1) has zero mean. 
E 2 k PM 2 2 
Eee) +. pr de, 


τς the variance of n(0,1) is unity, 


2 2 2 E 2 S 
E[z (K)] a (L-pg)” + 0% (1-947) (4-5) 
Erro σ΄ - temporal variance 
σε” ο τος in. One frame 
when Ty = σι Ξ σ 
DER 2 
EG] o w(i-p) (4-6) 


~q] 
ΓΩ 





ei gure of Merit tor Frame Differencing - 
Processing Gain 


EMO merit, “processing gain," is defined to 
describe the performance of frame differencing. The same 
ιο is used for processing gain for all filter tech- 
Mes developed in this thesis. 

2 
(S/N); 


PG = ———, τ 
(S/N): 


a 
where (S/N)g 


(S/N) 5° 


ο cWwereseenalctonorse ratio 


II 


DON es Mona το Moser ratio. 


σπα considered in this thesis are point target signals. 
EM. Chapter, it is assumed that these point target signals 


ο least one pixel from one frame to the next. 


5 
Bert Sy ο σοι ος απ the rirst frame pixel = s 
2 
eal omade power sin the Same pixel in the second 
frame 
= 0 because the target has moved away 
D ignal πο ο iu 
e æ = σ = - E 
T. onepu Signal power 1 7 
2 1 ς 2 g? 
i = Cc = = 
input mee Signal power 1 


I ornput noise power is 


à 2 2 
2 = + 
a EX x 
2 E : i 
where dy = input noise variance 
D SP nose mean power 


mie output noise power is 
τ Ze 2 2 d 2 
Ng = Elz ] = Oy (l-ex) - Se (1-97) 


with zero mean as shown by (4-5) 
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Nu efore, the processing gain is 
2 


S 
: 2 2 2 
(S/NX* — ay “(1-0 ) + 9," (1-0) 
PG = IE EA sec 
(S/N)*. ς 2 
5 μη 2 
aren x 
u 2 
l* me 
ER 
PG = ay (4-8) 
Bea 
( PK σχ “K 
E ue special case oz ο 0 
ie 
X 
ze (4-9 
DG A 1 4-9) 
2(1-Px) 


EM first diiferencing" processing gain will be used in 
section C.2 when it is compared with the processing gain of 


Beeıstical spatial-temporal filters. 


η... ΟΤΙ SEQUENTIAL SPATIAL-TEMPORAL FILTERS 

Menis section, a three dimensional statistical filter 
αρα It consists of a sequential application of 
Meveral spatial filters to successive frames ot images fol- 
my a temporal filter using these processed images. In 
contrast, another three dimensional filter processing signals 
from several frames of image all at once will be presented in 


the next section, D. 
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EM LIter Configuration 
The configuration of the sequential spatial-temporal 
filter is presented in Fig. 4-1. Its operation is described 


as follows: K frames of images consist of point targets 


contaminated by background noise. 


meee Spatial Filters for K Frames: 

Me detailed design procedure for spatial filters have 
Beem presented in Chapter lll. The highlights of their 
Operation will be repeated here for completeness of the 


Meer ipcion Of sequential spatial-temporal filters. 


[Unprocessed Signal] 
πο dimensional array of unprocessed signals in a 
selected search box around the estimation pixel (m,n) is 


taken from each frame. 


ieee SS | 
P c κ 

Re ο u (4-10) 
Er NSB MSE 


This two dimensional array of data is represented by a 


one dimensional vector. 


X = = = ο. Kirn. X1] CD 
j = MMAX(n-1) * m 

n= 1,... NMAX 

mnc c occ MMA X 


T5 





THREE FRAME SEQUENTIAL SpATIAL-TemPORAL FILTER 








k Frames 


spatially Y 
Filtered 
Output 


Temporal 
Filter Kk 


Spatial-Temporal 
Filtered Output 


Eure 4-1 Configuration of Nonadaptive Three Dimensional 
Nonrecursive Sequential Spatial-Temporal Filter 
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HH: 
il 


MSBe (An-1) + Am 
ime = 1, ο Νορ 
mum - 1,20. MOB 


NSB-MSB 


1 
BNDresented in Fig. 4-2. 
The unprocessed signal X contains target signals 
= hey 
5 [$1 $5 «S11 Ute) 


and clutter noise 
N = in, 15 +++ Ny] (4-15) 
Spatial Filter] 


A linear two dimensional filter is described by a two 


dimensional array of weighting coefficients 


A 
Buon) a ο Μα (4-14) 
"NSB,l '''''"NSB,MSB 


bt Can be described also by a one dimensional vector 
W = W(1) = [w] τ (4-15) 


Enese filter coefficients can be designed either by the 
minimization of mean square error criteria or by the maximi- 


matron Of Signal to noise ratio criteria. 


Epstial-Filter Output] 


M output of the Spatial filter is 


U 


y(m,n) = y = WeX (4-16) 








The Image Configuration 


X(m,n) = S(m,n) 
+ N(m,n) 


Image Size 
(MMAX = NMAX) 





— 


Figure 4-2(a) Coordinate System for the Image 
(b) Coordinate System for the Spatial Filter 
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meee li - Temporal Filter: 
[Input Signal] 

metered signals at the same pixel location (m,n) of K 
Mamés are put together to form the input signal to the 
Euporal filter. 

Y 7; 

BEemporal Filter] 

Peebinear one dimensional filter is described by a one 


Bamensional vecter. 


We = Wy (m,n) = [Wa OW KK! (4-18) 


Me ilter coefficients are designed by the same procedures 
used for spatial filters by following either the minimization 
mean square error criterion or the maximization of signal 


Eose ratio criterion. 


[Combined Spatial-Temporal Filter Output] 
Mrmr inal processed sienal at pixel (m,n) after the 
Beaguential application of K spatial filters and one temporal 


filter using K frames is described by 


z(m,n) = YW," (4-19) 


ο 


ratos tical analysis of Two Frame Sequential 
poatial- Temporal Filter 


A statistical analysis of the two frame sequential 
Exua3l-temporal filter will be analyzed first so that it 
MADE compared with the result of the nonstatistical first 


differencing method analyzed in Section B. 


.- 





The analysis of the more general K frame sequential spatial- 
tenporal filters will be presented in the next section. 


ae Statistical Model of Two Frame 
SengalesDrirtegenceing: 


The outputs from the spatial filtering are 
described by: 


xca»-wt where X(1) denotes X of frame (1) 


yeti) 
200720 5 where %(2) denotes X of frame (2) 
Mimatrix form, they are 


p y (1) w l o an 


A uS ra) 


το calculate the noise power of the final output, the 
covariance of the spatial filtered image, Ry y > is needed. 


EEune (4-20): 


i 
ΒΥΥ = eae som 
Seo eee cnc awe lo 
OB ου ου ο. 
Τ 
wio wo 
= i (os 
ϱ | Ν olw 





where Rex (1,2) - E[X! (3)X(j)] = covariance of [X] (4-22) 


It is assumed that both X and Y have zero mean and that frame 
απ frame (2) statistical properties are the same. 


Therefore: 
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Using the first order Markov model, as in section 


c. (4-2) the temporal statistical characteristics are: 
T - ih 2 
X (2) = op l*X (LANE Io, vT- οκ πι 0, 11] (4-24) 
where I is the unity matrix. 


Multiplying (4-24) by X(1) and taking the expected value 


fields: 


il 


ο (2) -X(1) | Ef [oy 1 X"(1) + 10175 n(0,1)]X(1)) 
Rey (2,1) = 9 EL (1)Χ(1}} +1 op YIP n(0,1)X(1) 
(4-25) 


lle second term is zero since n is Gaussian with zero 


...' “πα is not correlated with X(l). Therefore, 


T e 
CEDE ο ο p EDU QXQD = eR. (4-26) 


Eu Uttuting back into (4-21), 





wo 

R = 

YY olw 

T JÈ 
Πο εν λοι (4-27) 
T 
OW Ryy W W Ryy W 
W Ryy wi = Ὅτ is the noise variance of spatial 


filtered images since 
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κ 
ay = Efyty] = ELCWX’)(wx')] = Ex xew] 
= e i e T z e T 
= WeE[X X] WI = WeR,,W 
Therefore, 2 2 
DENM KY EIL EO: 
b 2 aco τ NOU 
PK?y oy 2 


PR Statistical Analysis of Two Frame 
Single Differencing 


The temporal filter Wy Used in this analysis 15 the 
Me first differencing operation, so that the temporal 
metered output is: 
Wy 20 sm 
η E ] een 4-29 
A = .. ΄ z = A = -2 
ο. ο ο κ (4-29) 
Mier variance of z is: 


2. EE Τι: n n er 
En NEIN IN (4-30) 


Mim@eestituting (4-28) into (4-30) will yield: 


M Te 211 PK 1 
οι Ὁ ο - [11]ey "E F 
M E 
τ Oy 211 ox) (4-51) 


[can be shown that the same result is true for 
a sequential filter by applying first the temporal differencing 


followed by the spatial filtering. 
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e, Processing Gain 


It will be assumed again that the target signals are 


meee targets which move at least one pixel from one frame 


mothe next, so that 


s(1) = s 
Sta ὃ 
En 1V.B.35. 
Therefore, 
ers 
ne Sol) οσο) = s 


Mies input noise power is given by 


ν΄ M 


assuming X has zer an. 
M X g S zero mean 


output noise power is given by (4-31). 


Emusdgly, the processing gain is: 
2 





S 
à 1 2 
σ io σ 
PG = y - K X 
2 Ey 
E 
2 
E NE i 1 
a "x WR We 2 (1- ex) 
JE spatial filter)*'(PG of first temporal 
an fieceneing) esa 
2 
using the relation R = o° RÈ 


XX AOS 
EL) shows that the processing gain of the sequential 


mial- tenporal differencing is a product of two individual 





Meocessing gains whereas the temporal differencing alone 


EMEND s only the PG related to the second term in eq. (4-32). 


ENEE5tatistical Analysis DEN Nomewoequentral 
cotal Temporal Filter 


In this section, a more general K frame sequential 
Spatial-temporal filter is analyzed. In this case, the 
temporal filter used is designed by a statistical process 
instead of the nonstatistical "first differencing" temporal 
ter used in the previous section. 


Eo ca tisticel Analysis ot Spatial Filters 
of Different Frames 


The input temporal signal from K successive frames 


is described by spatially filtered output Y where: 


Man results trom applying spatial filters to K frames of 


Mr ocessed signal X. 


y (1) AEN AE 
ΠΡ) 0 W 0 
| _ αν 
W 
Ν o. 
y (X) 0 W D) 
E. 
yi = wx? Cae) 


EEUU the covariance ot Y is needed for calculating the noise 


Meer Of the images processed by the spatial filters. 
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If we assume Y has zero mean, 


R = 


YY 
| BER -- 
i ance [Y] » E[Y «Y] = E[W- X *X-W ] 
s WE[XL-X]WI acs 
Bn. 
WR, Ἡ 


The same first order Markov model is used for the correlation 


of two successive frames. 
XI() = pp IX) (K-1) + I o,/(I=p,° n(0,1) 


Mmemerore, similar to eqs. (4-25) and (4-26), 


T _ b 
EN KA ρκ Rex (4-56) 
Similarly, it can be shown that 
jJ 2 
E[X (K) X (K-2)] = oq" Ry 
eee eneral, 
T NE M 4-3 
E[X OO X (K-2]. * e Ry (mm 
Eubstituting (4-37) into (4-35) and using the following 
myo relations - 
2 K-1 
O 
Rxx ?PKPxx.-. Pk Rx uc ος 
K-2 z 
x O ah 
Ryy =| PKAxx An xx d W 
πι 
Εκ. xx τν 
u (4-38) 
and 
a = WAR ¿WE πες: spatial filtered image. 
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l x οκ : DR 
Ko? 

p l ο p 
E d K K K 
YY Y 

M 

o? 1 
OT 

2 _pK 

eo, ο. 


... Πειε5ι. πα]γ5τ5 of Temporal Filters 
"τν, πο ρα τιο ο 1τετ cases in Chapter 
EMEN c statistical criteria can be applied to design the 
temporal filter. 


If the minimization of mean square error criterion 


IS used, 
us ie Pe (4539) 
eye | “NNK “SSK 
Rink = covariance [Ny] 
Rock eovarıance [Sy] 


MESS 


ADS Tone ca ret Signal and clutter noise are 
med to be uncorrelated. 

ema ma zar ion tor? Signal to noise ratio 
Meercerionis used, 


E (4-40) 


M ννκ! Sk 


y = C[R 
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selected constant 


where € 


Un 
li 


ΤΙ ector τη the same pixel along 
K frames 


[Sey SK? Ser τα where k = lig A a | 


NE nal output of the sequential spatial-temporal filter 


15 


The noise output power of z is given by 


TIN ee p k T 2 m 
EO e gu "Kk TY (ocn. 
Processing Gain 


Assuming again that the target signals move at 


meee One pixel from one frame to the next - 


where Sy = [0,0,...5,000..] τ ποπ; point target. 
Mmemost applications ot point target detection, 


S = S = 5 





out in 
N. = one frame input noise power = y e 
J s X 
Nout 3 output noise power after multiple frame 
filtering = c 
57 
2 2 2 
(S/N) g g 
pM — = = b (4-42) 
SEND T 5 g 
an ——> Z 
IR 





2 T 2 Pk Τ 
where g 


τ... Τα 
D πε. ο INT 
ο» We Ry yW = σχ W Ryy W 
ο 2:2 ORE e 
N y i 
Enally, 
E — =p ——— (4-43) 
. , τ”. 


ο ο spatial filter) (PG of temporal filter) 
Dey AN EFFECTIVE WAY OF HARDWARE IMPLEMENTATION 
ELEESEQUENTIAL SPATIAL-TEMPORAL FILTER 
Maethe previous section, a special class of a three 
dimensional spatial-temporal filter was developed in which 
nonrecursive spatial filtering andnonrecursive temporal filter 
were Carried out sequentially. They are described by the 


Nu owinge operations. 


I 
qe cow.) s XGy wi 
i=l 
I : T 
HEU xor 2)w(1,2) - X(2) W Spatial 
. 1=1 
NR τ᾿...” | T 
y(K) =, xG,K)w(i,k) = X(K) W 
E T Temporal 
2 "y YOR) wy OD =r We 
In general form, 
K MSB NSB 
z= E Wy Ck) > x dmn x Omm 
k=1 ΠΕ 


Bu 





type of nonrecursive processing requires the memory of 
all K frames of image data. 

i umishnt be possible to implement this type of three 
dimensional filter by only using one frame of memory and 
updating its signals in a recursive manner as follows: 

MSB NSB 


mos) z(k-I) + wy (Kk) Ἡ ο c mo m) 
m=1 n=1 


Maes approach of combining a recursive implementation of 
Meorecursive temporal tilter with nonrecursive spatial filter 
Mota. be used when the temporal filter is designed by other 
teria, such as by the Kalman filter approach, instead of 
the MMSE filter and matched filter approaches developed in 
this thesis. This recursive approach is suggested as a method 
mempe developed in possible future work. 

ENNGOMPUTER SIMULATION PROCEDURE FOR EVALUATING 

EEBUENTIAL SPATIAL-TEMPORAL FILTERS 

ime three dimensional sequential spatiai-temporal filters 
τς been evaluated by computer simulation using two types of 
images: 

a. Simulated images using Markov model clutter noise 

b. A real world infrared image. 
results will be presented in detail in Chapter VI. In 
pue following, software procedures for evaluation of these 


mee types of images will be presented. 
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1. Markov Model Simulated Images 

The following steps are used. 

 πειτητε two dimensional stochastic field with 
Metered Statistical properties to simulate the background 
τετ (Appendix A). 

b. Add a set of targets in the clutter to form an 
image. 

c. Generate K frames of images with specified temporal 
meeeistical properties. 

ANDES Ten Spatial filter and then temporal 
NES rS according to either MMSE or matched filter criteria, 
Exumized to the assumed clutter statistics and target char- 
Euristics. 

zu po ly sequentially the spatial filter and temporal 
filter to suppress the clutter and to enhance the targets and 
Date the processing gain. 

MC cuilatomantnnesnold setting according to a spec- 
ified probability of false alarm assuming that the probability 
memsity function of the filtered image is Gaussian. 

BE pes. tie wtnresnmold to separate targets from 
BNEUdual clutter. 

EMI World Infrared Images of Background Clutter 

Paleo tas tica properties are inherent in 
the images, no computer simulated clutter is needed. The 


following steps are used. 
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ν᾿... cherame, calculate its statistical 
οἱ properties such as mean, variance, probability density 
τση and covariance matrix. The exact calculation method 
meepresented in Ref. [30]. 

b. Design statistical spatial filters according to 
τ the MMSE filter criterionor the matched filter criterion. 

dd asset Of targets to the given infrared images. 

AA) ly che spatial filter, evaluate the processing 
eee and store the processed k-th frame. The detailed pro- 
cedure can be found in Ref. [30]. 

e. Repeat steps (a) to (d) for all the K frames. 

Mme abeulate the statistical temporal properties ot 
selected pixel locations a rames ort spatially 
filtered data. 

EMEN CSsuWEnesEStatestical temporal filter according to 
BEEN -r the MMSE filter criterion or the matched filter criterion. 

ο ουἳ the temporal filter, calculate the mean and 
Mmiemvyariance of the filtered image and evaluate the processing 
gain. 

aclare tae resholda setting for a specified 
ου οτί of false alarm using the method to be described 
Mamemapter V because the probability density function is 
generally non-Gaussian. 

e eo :ε επε ποια to separate targets, false 


mrarms from residual clutter noise. 


St 





F. SUMMARY 

Three dimensional focal plane processing methods are very 
effective in background clutter suppression because tne pro- 
cessing gains of spatial and temporal filters are multiplica- 
tive. A combination of spatial and temporal filtering should 
5» Improve the total processing gain. Furthermore, if 
m@emtemporal clutter noise is highly correlated, which usually 
is true if the drift and/or jitter between successive frames 
ma, the processing gain of a temporal filter is usually 
meemer than that of the spatial filters. An example will be 
Mmesented in Section F of Chapter VI. 

wahis Chapter, the configuration, design procedure and 
Memiormance analysis of nonstatistical "frame differencing" 
E ral filters developed elsewhere [10] were first presented, 
followed by the sequential statistical spatial-temporal filters 
developed in this thesis. It was found that the sequential 
Mepatial temporal filtering technique, when applied on real IR 
images, offers indeed superior processing gain compared to 


πετ Spatial filtering or frame differencing. 
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μυ ΕΕ ΕΤΕΙ ΙΝ FOCAL PLANE PROCESSING 


A. INTRODUCTION 

mamost infrared images, targets are deeply buried in 
Memsc which consists of strong background clutter noise and 
other random noise. The targets can be as weak as 70 to 80 
EN ow clutter.  Predetection processing must be used to 
Tess the clutter to the point that "target" signal to 
MINE cer” noise ratio is adequate for target detection. This 
Memeaiscussed in Chapters III and IV. 

e eet detection usually consists of several steps. The 
Meee step is "thresholding" which is the subject of this 
Br. This is used to separate targets from noise remain- 
Mater the predetection processing. Since both target 
Mas and noise after filtering are statistical quantities, 
EN Ucenerally difficult to clearly separate targets from 
mee ekc ept in rare occasions when the signal to noise ratio 
EN rv high. In most cases, the intensities of targets and 
EUNSe overlap. Any selection of thresnold will miss some 
τοσο and include some noise (false alarms). There is 
ene a compromise between a complete detection of targets 
using a low threshold at the expense of including many 
Baise alarms, and a complete elimination of false alarms by 
Eur 3 high threshold but at the expense of missing many of 


the targets. Two figures of merit are normally defined to 





describe the false alarm and target detection. They are the 
probability of false alarm (PrpA) and probability of detection 
(Pp). 

A target detection process involves five types of related 
Entormation: 


EE 1ος filtered targets and noise (PDF is probability 
density function) 


EE enal to noise ratio - SNR 

See threshold level 

ES Pra 

BEES Pp 
Er relationships to detection have been very well developed 
ΠΝ... ασ, sonar and elsewhere [31-335]. In this chapter, the 
one dimensional detection procedure is extended in a straight- 
forward way to two dimensions for application to focal plane 


processing problems. 


END EDETECTIION FOCAL PLANE PROCESSING FOR CLUTTER SUPPRESSION 

Clutter suppression is one of the most important processing 
Steps before the thresholding for target detection. Statis- 
ercal spatial filter and spatial-temporal filters have been 
ΠΝ... Πα in Chapters III and IV respectively. Their impor- 
pant steps and statistical descriptions will be reviewed and 
summarized in this section. 

statistical Properties of Unprocessed Image 

iieminprocessedmimace data taken from a two dimensional 


detector array of Am x An pixels are described by: 
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BEND °° μ5β.1 
Xx = 
*1,NSB ° ° ‘ *MSB,NSB 


Mamenis study, this two dimensional array is written as a 
one dimensional vector for ease of programming in processing 
software. 


IE (i) = ο... ο. 5-1) 


where i = MSB-(A4n-1) + Am Dues eM Sp 
An=1,2 


EN 

ISA transformation was previously presented in Fig. 3-2. 
Nl unprocessed image is considered to be the sum of target 
signals 


S= S(i) = [51 πο, ST] (5-2) 


Ip ucc osyonaidisccan De either deterministic or 
Mmemebstical. It is assumed that their spatial shapes are 
deterministic such as point targetorline targets of various 
ENentations. Their intensity amplitudes may be deterministic 
EN ractristical with Gaussian probability density functions 


Erumed. Deterministic targets are described by the vector - 
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ΕΙ’ are described by several 
w tical characteristics: 


Mean vector = ug - [Hg1 Hg2 ** Mgr (5-4) 


T T 
Covariance matrix = Ros = E[(S - ἃς ) CS - ug)] (525) 


ΓΩ 


Variance = To (5-6) 


Surocorrelaftıon function = Qs (27) 


Mie background clutter is statistical and described 


υπο following characteristics: 


Mean vector = Hy = i eee ΠΠ (5-8) 

Covariance matrix = R = NEQUE uy (N - 4,)] (5-9) 
; ΝΝ Ν Ν 

Variance = Pd ΠΠ; 

Emwocorrefjation function = Qu (5-11) 


eec omputer Simulated images, the clutter noise is 
Med by either the first order or the second order 
MERO” models described in Appendix A, and the PDF is 


assumed to be Gaussian. 


Single Frame Processing - Nonrecursive 


Æ tical Spatial Filters 


Two nonrecursive statistical linear spatial filters 
Meme developed to process the image signal X. 
Ister ers described by its filter coefficient 


ISE TOT : 


2 








Ww] (5-12) 


The coefficients can be designed by two criteria. A 
HNUmization of mean square error led to the spatial MMSE 
(or Wiener) filter. A maximization of output signal to noise 
mero led to the spatial matched filter. 


The filtered output is described by: 
Von ov Noc y) 


ED contains both the filtered target signal Yo and filtered 
clutter noise NC 
The filtered statistical targets are described by the 


MO wine statistical characteristics: 
Mean = Eus = ug* W 
Variance - ar fe We Rac* W 
Ys SS 
The filtered deterministic targets are simplv described 
ENEUerTr intensities. 
τς = SW ο) 


mvyewttitered Clutter noise is described by the follow- 


Euestatistical characteristics: 


I 
Mean = p 2 w(1)uy(1) = a (5-17) 
N 1 4 é 
ΠΕ = σ᾽ [ος 
Ν 


ο ο © (N-up) WT] 


W E[N- uy) (N -u IW 


F 
W RAN W 
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E Multiple Frame Be στους = Nonrecursive 
ο ο ο aal Temporal Filters 


In multiple frame processing, a one dimensional 
@emporal filter Wọ is added to the two dimensional spatial 
τς W. In this thesis, spatial filtering is performed 
first on several frames of images. It is then followed by 
temporal filtering of the spatial-filtered images using sig- 
nals from the same pixel location from several consecutive 
frames. This set of time-varying signals is described by 


the vector 


Yx P BED RE») 
Yy @emsists of target signals - 

Sy = E a K. (5=20) 
Bucorrelated temporal noise - 

Nx = [nk] B2, Nyx! (scq 


In the computer simulations reported later, only the first order 
Markov model is used for correlated temporal noise. The 


memporal filter is described by: 


(S222) 


EE utput spatial-temporal filtered image is described 
y : 

Los Y, W. re 
Eum. z also has its target components and clutter noise 


components. 
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πο. ντ σι enmporal filtered target signals are 


mescribed by: 


The signal intensity = Zo = Sk Wi (5-24) 
de terministic targets. For statistical targets, they 
are described by: 

Mean = uz = UY We CODI 

Variance - rm = We Rosg Wy (5-26) 


A RGET DETECTION IN FOCAL PLANE PROCESSING 
Two methods of calculating threshold level are investi- 


gated. 
1) CFAR (constant false alarm rate) 


2) Bayes criteria. 






Probability ot 
false alarm 


u 


Figure 5-1 


1. CFAR 
a Uiemernk sapproacn, the threshold level = VrH 1s 

elected such that Pra πο τοπ ασε It is important in many 

Peectical military applications because a system will operate 


for a long time without any target being present, facing 


mostly background clutter noise. It is important to know 
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the expected false alarm rate and keep it constant. Two 
methods of setting VrH will be presented. 


a. Gaussian PDF Case 


When the PDF of the filtered noise (denoted by 
Eus Gaussian, as shown in figure 5-1, the 
Busseshold level V TH “απ ο ονομα ίσα analytically as follows: 


P., = f P(ujdu = f Plu)du - (TH πηι »-αῃ, 


FA 
ΤΗ 


EN uSwn in Fig. 5-1 by the shaacc area. 


ü denotes noise variable 


u, * E[u] 
s c sp De 


Pees P(u)}) is a PDF, the first term is 1. The second term 
mene normal cumulative distribution function F(u) which is 


tabulated or can be computed using standard computer routines. 


Vou ^H 
TH u 
Ben = DEZE ) 
FA m 
Mens threshold equation is: 
aoe el (5-28) 
TH u FA u z 


σι can be found from s which is the variance of the 
EU tered noise given by (5-18) for the spatial filter case 
ΙΟΥ (5-26) for the spatial-temporal filter case. uu is 
Mae mean of the filtered noise given by (5-17) for the 


Beatial filter case and by (5-25) for the spatial-temporal 


[eter case. 
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In many practical cases, the mean of the filtered 


NUoNSe is approximately zero. Therefore the threshold level, 


Uc Ko (5-29) 


EN ScbDortional to the standard deviation of the filtered 
Error a specified Pra. For CFAR requirements, the setting 
of VrH is equivalent to finding the constant K. 
b. Non-Gaussian PDF Case 

ineweal world Situations, it was found that the 
Eo: clutter intensity is usually non-Gaussian. A typical 
example is shown in Fig. 5-2 which contains normalized 
ENEosrams of real world infrared scene. 


Fig. 5-2(a) -"APDF" of unprocessed image (''APDF'" is approximated PDF) 
Fig. 5-2(b) -"APDF" of spatial-filtered image 
Fig. 5-2(c) - APDF" of spatial-temporal filtered image. 


The "APDF' is achieved by evaluation of each pixel intensity 
BENUEEcounting all pixels with approximately the same intensity 
5S0 as to achieve the histogram. The histogram is then normal- 
ized so that the total area under the curve becomes 1 so as 
meeyicld the approximated PDF. 

It can be seen that the mean of the filtered scene 
Ee approximated by zero, and also that none of these ''APDFs" 
are Gaussian. 

Por chese cases, a numerical algorithm is devel- 


mto set the threshold for a specified PE ΕΙ ΤΠΕ 


A? 


basic assumptions are the following: 
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The APDE" of filtered image is available but cannot be 
expressed in terms of an explicit analytical function. 
The mean of the filtered image is zero. 


similar to the Gaussian PDF case, the threshold level 
is given by: 


Ver = Ko, (Gates estandard deviation 
τες image) 


K is to be determined by a computational procedure whose 

BN chart is shown in Fig. 5-3(a)(b). The false alarm rate 
Bee shown to be indeed constant for a given K considering 
mie following: 


oo 


BE - 1 p(u)du (5250) 
TH 


where ου τς any oıven PDF. The threshold level is selected 


mo be 
Vu = Keo Oz) 
where τε 
ο y u-p(u):*du = Ci (assuming u has zero mean) 
- 0 (5529) 


If we select C> SO@titat g = Y C4 - C. dadsmbpstitute eg. 


Eo) into eq. (5-22), the Pea for a given K is: 


+ œ 
P reo i cur scons Gant - ς 
FA 
K-C. 


3 


K=constant 


πμ. (5-25) shows that for a given K, P i constant, yielding 


FA 
ΝΙΝ. ΑΝ algorithm. In general, Pra ISE cio nto Kana 


can be expressed as Pea K). 


IMS 





Given the STEP 1 
filtered 
image 


Do 


Estinate STEP 


σι 


Generate STEP 3 
PFA(K) 


vector 


Select PFA. STEP 4 


Find K 
fram vector 


Set STEP SS 
threshoid 


Ver - Kec, 





E cf) Procedure for Setting Threshold in Cases 
of Non-Gaussian Probability Density Function 
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Figure 5-3(b) Flow Chart for Generating PFA versus K Curve 
Used in Setting Threshold 
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οι ο ο o e ads tep 1n this flow chart is 
E NM where we generate a vector (or table look up) which 
relates K to PEA [vector Pra (K)] for a given os and unknown 
EU rIsure 5-4 is a typical plot of such a table look up 
MemeGaussian PDF. In Fig. 5-5, the vector Pea (K) will con- 
En data similar to Fig. 5-4 but for the unknown PDF. To 
οτι 5τερ ἡ, a PEA has to be specified and then the vector 
Pra (K) cane searched (left to right) to find the first K 
povield Pra < Pra (specified). 

ENEDayes Criterion 
Biyessernterion is another method of threshold setting 
based on a priori knowledge of the target as well as the noise. 
The basic disadvantage of this method, compared with the CFAR 
BEEN Sch, is the requirement to specify the target, background 
Mer and their statistical properties. However, if this 
information is already available, the Bayes criterion can be 
useful. Otherwise, the CFAR approach is more useful. The 
ENS criterion is described in detail in Appendix B. 
ENEProbability of Detection 
gr Ππετοππεξτ ση 

keD probability density function (PDF) of the 
target and also the noise are known, the probability of detec- 
[on Pa) ca ea lcutated in a Straightforward manner. It 
Bhould be emphasized that the clutter noise considered in the 


ENUculation of Pi Ἱοι απ που -ασος, πο che unfiltered 
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PDF(S) of Signal Alone 





ασια ας yt ems ty 


PDF(N) of Noise Alone 





πο ο πο αν το 
ο ο SIN) Of Signal t Noise 
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Eom Density Function of 
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(b) Noise 
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Detection 
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Mi. 
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Eug 156 
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aleta ron Of Probability of 
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να 





rer, but the filtered clutter noise. Because in the 
entered condition intensities of targets are usually only 
w fraction of the clutter intensity, the threshold 
wd not be applied at this stage. Only in limited cases 
BEwrarcet intensity sufficiently higher than the clutter so 
that a threshold can be applied without any predetection 
processing. 

Two methods of calculating the Py are implemented 
MENS thesis. The first method is analytical and only 
ΠΝ... ο the special cases when the PDF is either Gaussian 
Ean be explicitly described by mathematical expressions. 
The second method is numerical and is applicable to any case, 
Erusdless of whether or not the PDF can be described by well 
known functions. This method is implemented in the computer 
ation by counting the detected targets and comparing 
their number with the number of inserted targets. 

Il oaussran PDF Case 

It’ the PDE of the clutter noise is Gaussian, the 
EIN thie processed clutter by any linear filter is also 
EN san, as shown in Fig. 5-9(b). Target signals considered 
EUth)s thesis can be either deterministic or statistical, as 
Ewno3n Fig. 5-9(a). Assuming the signal and noise are 
uncorrelated, then 


PDF PDFes) PDF is also Gaussian (5-34) 


(N) 


where * denotes convolution. A typical result is shown in 


(S+N) 


mes S-9(c). The resultant statistical properties are: 
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SN Ἡς Uy = mean of signal + noise 


2 2 


2 
σ τ ο = variance of g + 
S+N S N rian signal Horse 


u 
Q 


The mean and the variance have been calculated 
EN uapter V, section B. 


For a selected threshold V Pie propabı Lıcy 


TH? 
EN cesectron is given by the shaded area in Fig. 5-10 and 


"ΙΕ determined by the following integration: 


τν xU D 
Pa = f - I exp [- 5 (25) ices 
VH ^". ?s«N zs 


AS A 


f N(g,g Os D d(S*N) - /— NGug,u 0s d CS*N) 


- O00 


li 


V 


=p 
Pa = 1 AA) (5-36) 
S+N 
X 
where meg = jJ UNO, I)dhn 


Tonma lSeumu lative distribution function. 
Man be easily evaluated by using the error function 


.. De available in most computer libraries because 


m 2PO2x)-I (55955) 
C. Non-Gaussian PDF Case, E 
ο τ ΙΙΙ ΓΙ Unprocessed Clutter noise 15 
En  :han Gaussian, the PDF of the processed clutter is 
EEnerally not Gaussian. The processed clutters PDF can be 


Setained wither analytically or by a best fit algorithm, and 
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the PDF of the processed signal plus clutter can be obtained 
as well.  Denoting the PDF of clutter as P(N) and the PDF of 
Benz plus clutter as P(S*N), the resulting probability of 


detection is given by Pa Spee oe ad NS 
BI 
D. SUMMARY 


Maree Major steps in target detection are discussed: in 
αρ First, the probability density function (PDF) 
of both filtered image and target signals are determined. 
Next, based on the PDF, a threshold can be calculated for 
Em ospecified probability of false alarm. Third, from the 
EuEsHhold, the probability of detection can also be calculated 
Bene the known PDF. 

If the PDF of filtered clutter noise is Gaussian, both 
ae threshold and ος can be theoretically determined. Other- 
E they must be numerically calculated using the mom 
E Typical results based on computer simulations will be 
Emesented in Chapter VI where predetection processing using 
Meaeistical spatial filters and temporal-spatial filters for 
Meter suppression will be combined with thresholding for 
target detection. Both computer simulated images containing 
Markov model clutter noise and a real world infrared back- 
ground image will be used to test the results of focal plane 


Processing. 








VI. PROPERTIES AND PERFORMANCE OF NONADAPTIVE 
οι ο.  υ.  οδ PLANE PROCESSING - 
NONE CURS ΕΕΣ FOR CLUTTER SUPPRESSION 
FOLLOWED BY THRESHOLDING FOR TARGET DETECTION 
ES INTRODUCTION 
Weal plane processing consists of many steps. It is 
Started at the optical detectors. After detection, multi- 
Ems and signal conditioning, the first two steps are 
Meret suppression and thresholding. Following these, image 
Eu Weement techniques may be used to improve the shapes and 
τος of targets, linking procedures may be used to con- 
nect moving point targets from many frames to form tracks in 
What is sometimes known as the "track association" or "track 
assembly" processing, trajectory estimation techniques may 
be used to determine the dynamics such as velocity and 
Ex cgeration of the targets, pattern recognition and discrim- 
imation techniques may be used to obtain more information on 
το All of these additional processing techniques 
meee Used to distinguish true targets from false alarms. 
mewever, this thesis is concerned only with the first two 
meee background clutter suppression and thresholding. 
iEErevrous chapters, the principles and design proced- 
EN wortour focal plane processing procedures have been 


developed. 


ΠΠ 





© For background clutter suppression: 
Chapter III - Single frame focal plane processing: 
MMSE filters 
Matched filters 
Chapter IV - Multiple frame focal plane processing: 
BILE METUS 
Matched filters 
Bor initiation of target detection: 


smnapter V - Thresholding 


In this chapter, quantitative results of these focal 
plane processing procedures will be investigated and analyzed 
More detail. The organization of results of computer 
simulated analysis and tests are described in the following 


EEctlon. 


NO RGANITIZATION OF COMPUTER SIMULATED STUDIES 


Types of Focal Plane Processing Procedures 


Four focal plane processing procedures have been 


@eweloped, as listed above. Two are spatial filters which 
use one frame of an image. Two are spatial-temporal filters 
Which use several frames of images. Each of these filters 


meetollowed by a thresholding step. 
NE nportantereatures of these filters are: 
Mor spatial filters: 


Mea ren DoOX 


Ela 





ο υπο ὁ πο συ 15 in the center of the box 


ο πο Ses LE” ls moved to the edge or 

ο πμ ος ese arca box when tre estimation 

Po) πο edges Of corners of an image. 
Emus are considered in almost all cases. 
Por temporal filters: 


Ξε] Έντο tires or five successive frames. 


E --cUINSCUODEDOint 5 im the middle of successive 
ο πας Umbpyccc second frame for a 5 frame 
empora ilter, third frame for a5 frame 
eemporal filter. 
Eonar ei S are considered which move at 
aeeoe pikel from one frame to the next. 
Types ot Images Used in Computer Simulation 
Ivo classes of images are used. 
a. Computer Generated Images 
Unprocessed images are generated by computer 
Simulation and contain three components: 
oemet T Mostly point targets, described 
E neir locations and intensity. 
ο... eon lated random noise is described by 
Be mean, which is usually zero, and variance a 
(3) Correlated random noise - Two types of Markov 


processes are used to describe correlated random noise. The 


detailed theoretical model analysis is presented in Appendix A. 


ΤΙ 





Erst order: Q (m,n) 


ll 
Q 
Gar 
pa 
© 
du 
D 
= 


à m n 
Second order: Q(m,n) = σον ol" lol cos (8,*m)cos (&,* n) 


It can be seen that three parameters are needed to 


"στο the first order Markov model. 
2 


σον - variance of correlated noise 
Pyu = Hone ontal correlation factor 
Py sA e CCa N Correlation factor. 


For the second order Markov model, two additional parameters 
Aer needed. 
8j; = horizontal spatial frequency 


By 7 cured spatial frequency 


b. Real World Infrared Image 
Twenty successive frames of a real world infrared 
.... in the medium wavelength infrared spectral band are 
used in the test of sequential spatial-temporal filters. 
The target intensity and the unprocessed 
image are combined together and described by another very 


important parameter. 
put cignal to noise ratio = SNRI 


3. Properties and Performances Evaluated 
The following properties and performance figures of 


Merit are evaluated. 
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Eni" oUp pression: 
Commerce teeGectrTelents as functions of input 
mum CO noise ratio and correlation factors. 
oe sere fail as functions of input signal 
memmolse ratio and correlation factors. 
(3) Spatial side-lobes after the application of 
mera! filters as functions of input signal to noise ratio. 
EE ouresuold Detectrlion: 
(om atesnold levels as functions of input signal 
Bemmoise ratio, using the probability of false alarm (Pra) 
as a parameter. 
Mio pablito detection as functions of 
.. sisnal to noise ratio and probability of false alarm. 
Sens itivity Analysis 
ΙΙ momreeursive filters developed in this thesis 
ΠΕ ἃ common set of mathematical operations which is the 
summation of weighted and delayed signals. The differences 
Eus four nonadaptive filters developed in Chapters III and 
Band adaptive filters to be developed in Chapters VII and 
ὅτε ἱπ the criteria and design procedures of their 
NN er coefficients. Therefore, there exists a real interest 
Mos ing new sample analog tapped delay line devices which 
w ciently carry out the nonrecursive filter operations 
at high speed because it is a pipelined and parallel processor. 
However, the disadvantage of sampled analog tapped delay line 


implementation is its lower accuracy. Therefore, a special 


AS 





mavestigation is Carried out by truncating and rounding-off 
Bene etilter coefficients to simulate the lower accuracy of 
sampled analog implementation and investigating their 
effects on filter performance. 
EN 5uboptimal Piiter Investigation 
Mimouaccrcaleapplications the noise parameters tnat 
were used to design the filter coefficients might be in- 
wate, resulting in a "suboptimal" filter. The suboptimal 
enter performance is investigated in this thesis by monitor- 
' 6 PG of a given “suboptimal” filter while the background 
noise correlation factor CO = Py) ehane ed irom 0 to. 
να FRAME PROCESSING I - NONRECURSIVE SPATIAL 
EUSECPILTER FOLLOWED BY THRESHOLDING 
I introduction 
Mm isotropic second order Markov process model is 
ased to simulate the correlated spatial noise in this section. 
The spatial frequencies of the correlated noise are 
ie Sy EV DS c seine horizontal and vertical correlation 
"15 are varied. The variance of the correlated noise is 


8 


Mme ihe variance of the uncorrelated noise is 0.01. The 
Meet intensity is also varied and is described, together 
.. the spatial noise, by the parameter “input signal to 
morse ratio" (SNRI). 
fee iter Coefficients 
Since the unprocessed images contain only isotropic 


weon noises and point targets, the filter coefficients are 


LG 





EEntrally symmetrical. Of the nine filter coefficients, 
Mere are only three distinct values: center coefficient We, 
Mernmer coefficient ΤΗ Wo» and edge coefficient 
i> Ny = We = We. They are presented in Fig. 6-1(a) and (b) 
ENrunctions of input signal to noise ratio and for five 
different correlation factors, Pr, = Py = p = 0.999, 0.99, 
ENS and 0.4. It should be pointed out that p = 0 cor- 
responds to the uncorrelated random noise case and p = 1 
meeresponds to the deterministic case. 
The following observations of their behaviors are 
made. 
a. Symmetry 
Filter coefficients have a central symmetry as 
@escribed above. 
Sree oecrtticient Values 
All coefficient values are less than unity. They 
are easy to implement in hardware if sampled analog image 
Processing is used by simply using a resistor potentiometer. 
The sum of nine coefficients is very close to 
EN C his implies that this type of spatial filter will 
Usually suppress the spatial mean of background noise. It 
can be considered as a "whitening" spatial filter. 
τν e pendcenceron Correlation 
ο Οοιππεια του actor approaches unity, the 


filter coefficients change less and less as p varies and are 


MO” independent of input signal to noise ratio. In the limit 


TETUR 
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Mao = 1, the filter coefficients approach the values of a 
Seeatial Laplacian mask in those cases when 8, and By are 


Ew («0.26). 


he Laplacian ΝΜ» υ ο. 
mask for point 
mar get: ο» ji πρι ο 


For high values of spatial frequencies, and Sy ο 1δ]. 


"H 

mm@eetiiter coefficients are different than the Laplacian mask. 
In the other direction, when 9 approaches zero 

η η. ht filter coefficients other than the middle coeffi- 

cient are decreased. In the limit of p=0, oniy the middle 

weent is non zero. This indicates that in the extreme 

case of uncorrelated spatial noise, there is no help provided 


ENsoUns neighboring signals to estimate a point target and 


Memsuopress the background noise because the noise is not 


Eorrelated. 
a Peb»endencescon Input Signal to Noise Ratio 
Filter coefficient values become smaller as the 
EEUU SNR is decreased. It can be understood because the MMSE 


EN 17 3s designed to give the optimal estimate of the target 
Mal. When the noise is high, the filter tends to attenuate 
mm@enmo1se by smaller coefficient values and to yield the 


estimation of the small target value. 
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5. Processing Cain 


Processing gain of the spatial MMSE filter is pre- 
memecd in Fig. 6-2(a) as functions of input signal to noise 
νος different correlation factors and in Fig. 6-2(b) 
Mmerunctions of correlation factors. The following obser- 
mti ons are made. 

Me pendence on input Signal to Noise Ratio 

MeRa e eane eain of spatial MMSE filter for 
punt target estimation is independent of input SNR. 

b. Dependence on Correlation 

The processing gain is strongly dependent on the 
elation factor. The higher the correlation, the larger 
Ecessing gain can be achieved, but this will be affected 
EN he intensity of uncorrelated noise components also in the 
Meee For example, in this particular case, the PG of approx- 
EDI; 45 db 1s achieved for p = 0.999, as shown in Fig. 6-2(a). 
If the uncorrelated spatial noise is excluded, which is the 
τι 6-2(b) when p= 1, the PG can be as high as 60 db. 
mmeortunately, uncorrelated noise always exists in real world 
images due to background shot noise, electronic noise, etc. 

As οι ο προ 2er0, tne PG decreases. In the 
mort 9 = 0, PG=1 which confirms the discussion in the last 
Eon on filter coefficients. 

Erhreshold Level and Spatial Side Lobe Level 

Threshold level and spatial side lobe level are 


related because if the threshold is set below the side lobe 


II 
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level, a false alarm will result. The spatial side lobe 
level is determined by multiplying the highest positive 
filter coefficient with the target level. 

In Fig. 6-3(a), (b), threshold levels are plotted as 
mametions of input SNR for several values of probability of 


νυ» 


mise alarms from 10. and a given correlation factor. 
Curves are presented for 0 = 0.99, p= 0.9, p = 0.8, and 
P= 0.4. Two observations are made: 
A ep endenceren torre lation 
As p is increased, the threshold value can be 


lE cred to achieve the same P ma Si o because the pro- 


PAD 
meee cain of the spatial MMSE filter is better for higher 
5, 

b. Dependence on Pra 


As P is reduced, threshold value must be in- 


FA 
Ereased. 

τ, ΒΕ 186 151615 are presented in 
meee o-5(a),(b) as well as functions of input signal to noise 
meso. By comparing the threshold level plots and side lobe 
EXC! Plots corresponding to the case of p = 0.9 in Fig. 
6-5(a), it can be seen that false alarms due to side lobes 
EE occur for input SNR approximately above -4 db for 
threshold levels in the range o Pr, < 10 
Bee rProbability of Detection 


A set of figures (Fig. 6-4) is used to present the 


Emobability of detection, Pp: Pe actos tor Input SNR for 
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several values of Py, from οι το 117. "Each tisuce tor 


Selected correlation factor, ρη = Oy. 

lr should be emphasized that the two figures of merit 
of PG and P must be used together in the evaluation of 
effectiveness of focal plane processing. Otherwise, mislead- 
ing evaluation could result as demonstrated by the following 
example. 

Consider a case of p = 0.9; the processing gain of 
SAS spatial MMSE filter for point target estimation is 20 
Bert could be interpreted that any target of input SNR 
Better than -20 db, say -12 db, can be detected. However, 
the Pg o Elg. 0-4 reveals that for Pra = WS. c 
probability of detection of a weak target of -12 db is very 
low. E is less than 0.9 even for a stronger target of -7 db. 
«σος, the capability of a focal plane processing process 
EN Usting of a spatial filter for clutter suppression (eval- 
uated by PG) and thresholding (evaluated by P,) must be cor- 
meetly determined by using both PG and P 

6. Summary 

EmesbishgPights of the first type of focal plane pro- 
EE UMP which consists of spatial MMSE filtering and thresh- 
ding are: 

Te processing gain is strongly affected by 
elation factor, relative intensity of white noise, types 


ENargets, search box size and location of estimation pixel 


Beet. 14]. 





υπ ας ασος not affect the processing gain 
Mi 11 influence the probability of detection. 
GCE FRAME PROCESSING II - NONRECURSIVE SPATIAL 
ERMOHED FILTER FOLLOWED BY THRESHOLDING 
men Introduction 
The same unprocessed image used in the study of 
Momrecursive spatial MMSE filters is used in this section. 
There will be a great deal of similarities in the organiza- 
Mmeemeor presenting the results also. 
ES Filter Coefficients 
wure 0 Sa), (D), (c) presents the filter coefficients 
w unction of input SNR for several isotropic correlation 
NIS. Since point targets are being considered and only 
[sotrOpic noises exist in the unprocessed image, the filter 
Boerfıcıents have again a central symmetry. Only three of 
the nine filter coefficients need to be presented - W(1), 
EU and W(5). 
It can be seen that their values are not only very 
EN. but also have strong dependence on the input SNR. Both 
AtS are inconvenient in hardware implementation. (It should 
e enembered that in spatial MMSE filters, the filter coeffi- 
EXents are all less than one and are independent of input SNR.) 
These difficulties with the matched filter can be removed by 
a proper choice of the constant C in the solution of the 
E 6πε equation (5-4.28) to normalize the filter coeffi- 


Bent for the estimation pixel to unity. Figure 6-6(a),(b) 
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shows the dependence of filter coefficients after the normal- 
ization. 

Other observations made for the MMSE filters also 
ΠΝ. . tor the matched filters. 

E Processing Gain 

The processing gain of the spatial matched filter for 
target estimation is presented in Fig. 6-7 as a function 
ENENDUt signal to noise ratio for different isotropic corre- 
Eon factors, Og = Py: 

Poet. cine general observations obtained for the MMSE 
filters are also valid in the matched filter cases. In fact, 
EN  "»aring Fig. 6-7 with Fig. 6-2(a), 1t is discovered that 
ουσ the filter coefficients for these two filters are 
Meee ditferent, their processing gains are the same. This 
NI can be justified by using the following reasoning. The 
MMSE filter is designed to suppress the noise and to yield the 
MmemereStimate of the signal. The matched filter is designed 
only to suppress the noise but also to enhance the signal. 
This second feature of the matched filter results usually in 
Eus) distortion in contrast to the MMSE filter which is 
πες to yield the best estimate of the signal. When the 
Memeermed signal is a point target, as in the above case, the 
ES irTzed matched filter cannot affect the signal and there- 
fore both matched filter and MMSE filter will only suppress 


Mie noise to the same extent, resulting in the same PG. 
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4. Threshold Level and Side-Lobe Level 
Threshold levels are plotted in Fig. 6-7(a),(b) as 
l 


functions of input SNR for several values of PL, from 10. 
D 


Mle and a selected correlation factor. Several figures 
Mmeespresented for different o's. 

Side lobe levels are also shown in Fig. 6-/7(a), (b) 
EN Unctions of input SNR. 

Bryan, Schere are many similarities between the spatial 
matched filters and the spatial MMSE filters presented in the 
'  Ξεςεἵτοι. It should be noted that the threshold level of 
the normalized matched filter does not vary with SNRI as it 
Mees for the MMSE filter. 

ENUProbability of Detection 


The probability of detection is presented in Fig. 6-8 


1 


Bemcunctions of input SNR for several values of P., from 10 


5 


FA 


Ho l0 Breheriouresis for a selected correlation factor. 


Se Summary and Comparison with MMSE Filters 

Mfamparine spatial matched filter results of this sec- 
ENoncand spatial MMSE filter results in the previous section, 
Many similarities are observed. The only difference is in 
the filter coefficients. It must be pointed out that these 
observations are true only for point targets. For other 
targets, MMSE filters and matched filters will not be as 
Similar as in the case of point targets. It is believed that 
for extended targets, the matched filters will offer more 


το processing gain and probability of detection because 





Loqyowereg = Vid :([qdPp] IANS) 


jo uorjoungj e s? (T]S) 19497 ago eprs reraieds pue ( 


00°0 00°h- 00'8-  00'21- EERS 00" h2- 










"ο 


08 


00° Ἢ 00'8- 00'cl- bg DUNS oz. 00 * hc- 






00°0 


qp ut or3ey γη Teusts ınduj 





000 00'h- 00'8-  00*21- od 31 PIN 2 - . 00'he- 
te eee er UMP bor οὐ πᾶ. 
| 77 

e 
ο 
OD 
= 
2 
6670 = ^d - lg 
TIS e 
e 


00'8- 00 ci WO ds INS. me 00 ας 








00°0 


it eH + ot 











..-ϕ.---------------------ϕψ.------------------ψ-------------Ύ------- ot P M p YF - ————— —————$ ot 
-- ut e 2 πε τι |; 
A A e OT 7 : Se i ————À M p —— ——— nn = 
τα 5 H- ES 
δ--------β-------------ϕ---------Ἑ-------Ὁ------------5 ot 2 Oe ee ΝΕ οι 
G- —— 
N 
5 2 
σι o 
(ES) Ον 
Λ H damn A H 
6 0= d= d 66'0= d= d 
ΠΗ, e HI o 
A Ν A fo 
oO co 





LA) 19497 PTOUYUSI9IUL (8) /-9 *3T+:] 


O 








00 


Qe 


Of 


pg 


08 


A9J9Weled = 
| [ap] runs 
00°0 00°h- 00'8- DOS t— 00'9l- no'oc- ΩΩ "Πο 
PERA NE RES ES EI 5-5 i = - EE [o re cc p En 
μέ en ied 
MC SM 

η. 

11S 
u0°0 00 'h- 00° 8- 00 σ[- οὐ 17) PANS, "De- 00 “he - 


ee nen rr a 





HL 


oO 


O 
eo 


00° 


οὐ ὁ 


EE 


00 


00 


Vid *([qpP] INS) dp ur oraey esroN 03 peugdrs Indu] 
jo uor32unj e se (TIS) 19437 94ο] eprs reraedg pue (HLA) [oAoq prouseuur (q),-9 ‘STA 


€ 
yo. haPl runs 


00'8-  O00'el- 





00'0 00 'h- 00 Oc 
A po ee zer 
77 εν 
: A 
ΟΞ ΟΞ 
000 007^ h- 00'8- OO <i; (8 B] PNS,. οσο. 
A NN AA ο ο and NIS [E 
------------------------------------------- 
rr 9 
— —— M —————————— ———————— ————— - 
—_—t — y φ 
M 6. — q—— 9 9099 
E Á 
8°O= d= 


ONE 
o 
O 
o 
nv 
O 
> 
Te 
O 
O 
a 
© 
H 
d 
e 
IS s 
|o 
00" πε. 
Te 
e 
| 
ot 
1 o 
d= 
e 
ot 
Cm 
pe = 
oS 
he 
ot 
Ç- 
u 
O 
H 
d 
HL. H 
'Alo 
O 


156 








00'0 


Ja zoweied = 


[ap] pine 
DOS 





00*8- 


OT 
I» 


00°8- 





ου cl= 


goes 


Vid ‘UNS indu] jo uorjounj P s? UOI32919( το ÁKÁ1tTtqeqoag 9-0 














"dd 
[AP] THNS | LAP] TUNS 
00'9f- 0092- ου he 000 00" h- 00*8- DO" 2 1> 00'9I- 00*02- gotea 
en : acq - eee x PA, 
Q o 
O e 
> o 
m n) 
e C 
z o 
el E 
e O 
> o 
o o 
p 0 = ^d = Hg o σι 
o o 
Ὁ Ὁ 
o O 
p 
d 
e e 
ΓΗΣ ]WNS SIXU X = 
ου 9r- 00*02- DO. hos 00°0 00'f- 00'8- 00°21- 0091- 00*02- DO *he- 
> . -.  —_  _—__—_— ἂ . . . --. αι C 
8 o 
O 





“0 


De 


Oh 


09*0 


08 0 


66'0 - Ag - Hg 


o tE > AY --z--—_A Mmi ID 





656 


Π8 6 


το 


96 
„OT 


86 6 


1 


Γ-. 


τη 





the matched filter is designed to enhance the target as well 


BEN Uppressing the noise, as mentioned in VI.D.3. 


Se oUBOPTIMAL SPATIAL FILTERS 
EEUU 5 Coefficients Accuracy 

When filter coefficients are inaccurate due to round- 
ENS ror or other implementation constraints, the processing 
EE 1! deteriorate accordingly. Fig. 6-9 presents the 
EN Uoration in PG as a result of artificial coefficients 
round-off at a certain location after the decimal point. It 
1s seen that round-off at the fourth place after the decimal 
point hardly affects the PG. 

EN uboptimal Filter Performances 

When the correlation factor of the noise is expected 
to vary within the image, it is necessary to determine which 
Exe best "suboptimal" filter. Figure 6-10 shows the 
Meng PG when a filter designed for a correlation factor 
Mee 0.999 is facing a correlation factor that varies from 
EE Comparison of Fig. 6-10(a.1) with Fig. 6-9(a.1) 
EE 36s that the resulting deterioration in PG in various p's 
BExtrom 0 to SON o tires ο- δα δη ία. ο), (ία. 4} ἅπά 
Mare similar to Fig. 6-10(a.1) with filters designed for 
EE. 0.9, 0.8 and 0.4 respectively. 

The strongest deterioration in PG is noticed in the 
mepoptimal filter related to 9 =0.4 (Fig. 6-10(a.5)) and the 
least deterioration is noticed in tne filter related to 


EO 999 (Fig. 6-10(a.1)). 
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ου πα hersbesc suboptimal filter in this case 
was found to be the one designed for 9=0.999. Similar sub- 
ΠΝ. τὶ studies should be performed to select the best "sub- 
@ecamal'' filter whenever noise statistics are expected to 
vary and when filter coefficients cannot be adapted on line. 
MeeeMULTIPLE FRAME PROCESSING - NONRECURSIVE SEQUENTIAL 

ere tiAL-TEMPORAL FILTER FOLLOWED BY THRESHOLDING 
IN Introduction 

evaluate three dimensional spatial-temporal focal 
Mane processing, successive frames of images are needed. 

In Chapter IV, theoretical moaels based on Markov processes 
Mere used for correlated noises. In the spatial domain, 

both first order and second order Markov model correlated 
Seatial noises are considered. Only first order Markov model 
was considered for the temporal correlated noise. 

Eus seettion; instead of using those computer 
generated images containing Markov model correlated noise, 
ος ος of real world infrared images of 32x 32 pixels with 
Memscant drift of 10% of a pixel between frames is used to 
τε the performance of the sequential spatial-temporal 
Euer followed by a thresholding. Except that it was orig- 
inally taken by an ERIM? background measurement and subse- 
quently modified by another group to include drift and several 


other modifications, no detailed information was given because 


“ERIM is the Environmental Research Institute of Michigan 
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Mete classified nature of the program which developed this 
Bene as a standard test for focal plane processing algorithms. 

Eg section, ¡statistical spatial filters are 
Eust designed for each frame to suppress clutter. The sta- 
.. «81 spatial correlation properties of every frame of 
wenes are calculated separately and used in the filter 
design. Then, several frames of these spatially-filtered 
Mates are used together for the calculation of their temporal 
correlation properties which are used to design a temporal 
Er owhich will be applied to several frames of spatial- 
Ν... 1 images to give one frame of spatial-temporal filtered 
image. A threshold level is then determined from the PDF of 
πεις of the filtered image and applied to initiate 
Mme target detection. These procedures were developed in 
meee r thesis by Captain D. Hilmers [30]. 

ENEvatial Filters and Their Performance 

Figure 6-11 is a nine gray-level* computer overlay 
print of one frame of the real world infrared image. Figure 
eas a Plot of its probability density function. The mean 
1s found to be 4.05 and the variance is .45. Six moving 
τος of intensity 0.001, shown in Fig. 6-15, are added to 
mits frame of image. This corresponds to an input signal to 
memse ratio of -72.3 db. The targets move down 1 pixel for 


each frame. 





Ene gray level: "blank" -,+, V, M, 0, 0, 8, E, FÆ 
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E nscIowwWIDUC SNR and for point targets there 
is no difference between the MMSE filter and the matched 
Mercer. A 3x3 spatial filter is designed and its filter 
Me@erricients are shown in Fig. 6-14. This spatial filter 
is then applied throughout this 32x32 image. The spatial- 
filtered image is shown in Fig. 6-14 with its new PDF shown 
Eus. 6-15. It can be seen that the new PDF is somewhat 
Euwetrical around zero intensity, indicating a zero mean. 

EN  uporal Pilter and Its Performance 

Five consecutive spatial filter frames of images are 
entered by a temporal matched filter whose coefficients are 
MEg. 6-16. The resulting temporal filtered image 
EN Un in Fig. 0-16 with its PDF shown in Fig. 6-17. The 
Enpcessing gains of both the spatial and temporal filters are 
Ns ted in Figs. 6-14 and 6-16 respectively. A threshold 
Meethnen set to yield a Pra of u and the resulting image is 
Ben Big. 6-18. It should be recognized that the third 
frame is the 'estimation frame" of this five frame temporal 
ENUter. Consequently, the targets in Fig. 6-18 appear 3 pixels 
Bun relative to their location in Fig. 6-13. 

Conclusions 

The spatial-temporal filtering method is a very useful 
Eque for suppression of correlated clutter and detection 
of low signal level target. In the general case when K two 
dimensional frames of images are given, an optimal spatial- 


temporal filter can be designed for a given shaped target to 
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achieve a certain processing goal. These goals and the 
Mesuiting filter design method have to be evaluated for the 
Mc ular application. In this chapter, a spatial temporal 
filter for the enhancement of moving point targets has been 
designed and tested using real IR clutter images. The 
NEUES indicated that this type of filter can yield a 


Enocessing gain as high as 60-70 db. 





LE eee eve OPATIAL FILTER I - 
ION ARCO TTERSSTATISTICS 


Be INTRODUCTION 

Nprevious chapters, two types of filters were discussed: 
the two dimensional and three dimensional MMSE filters and 
matched filters, along with their design and implementation 
Behemes. The performance of these filters was analyzed and 
E uted. They both offer significant suppression of clutter 
Meee when properly designed. The first problem we face when 
Meee tO design the filter is the unknown statistical proper- 
E 1: the noise. The second and more serious problem is 
meemionunitormities of the statistical properties of the noise. 
Ether words, the noise is nonstationary. 

Memenis Chapter, a two dimensional adaptive filtering 
wue will be developed for cases where statistical 
Escrties of the noise are unknown but does not vary (sta- 
EU statistics). Extension to the nonstationary statis- 
Meee properties of the image will be presented in Chapter 
meee An adaptive algorithm will be developed first for the 
Euer filter, followed by a suggested modification to the 


Matched filter. 


See ADAPTIVE WIENER FILTER 
The requirement for this adaptive algorithm is to change 


τι coefficients to minimize the mean square error as 
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Mas possible based on the clutter noise characteristic. 
The adaptation is achieved by utilizing the steepest descent 
algorithm together with a proper selection of required refer- 
ence performance. Steepest descent is a well established 
technique for one dimensional adaptive filters. Extension 
of this technique to two dimensional adaptive filters will 
be presented in the following sections. An implementation 
scheme will be suggested along with simulation results and 
performance analysis. 

E ould be pointed out that there is another important 
w erence from the previously developed one dimensional 
filters. Most one dimensional adaptive filters are designed 
EN orate in a white noise environment with correlated 
Esset samples. In this study, instead of white noise, we 
racing a highly correlated noise. On the other hand, 
Bareets are often uncorrelated. For example, point targets 
meemuncorrelated in both x and y variables. Horizontal line 
Meets are uncorrelated in the vertical direction. 

There are two approaches to suppress the correlated 
noise. 

ieee first approach is to treat the correlated noise 
ΠΝ τ were a "signal" and try to predict (or estimate) its 
Mae in each pixel. Reference 34 demonstrates this basic 
Boncept utilizing an adaptive filtering technique. Refer- 


Mees 15 and 35 demonstrated again this concept by utilizing 


HESS 








meewO dimensional Kalman filter rather than an adaptive 
uter. 

Te second approach is to treat the correlated noise 
as "noise," and to design an optimal noise suppression tech- 
Megue based on the statistical noise and target character- 
istics. 

In this work, the second approach is taken by direct 
EN UStron of the filter coefficients so as to minimize the 
Mean Square error between the target and the target estimate. 
approach was selected since it seemed to be easier for 


Exsetical implementation. 


Sear LIVE ALGORITHM BASED ON STEEPEST DESCENT 

Steepest descent is an effective adaptation technique 
and was shown to be superior [21] to other adaptive methods 
when a reference input can be specified. 

The analysis of this method is similar to the analysis 
Semmonrecursive spatial filters presented in Chapter III. 


input signal vector, Xi πο ος με ας 


T = - 
E = TES E (7-1) 
J J 1 J 
Me filter coefficients are 
E W w. ] (07523 
poe Np 
J J J J 


The input signals are assumed to appear simultaneously 
Meat! input lines at discrete spatial locations indexed by 


EN5ubscript j; j is the pixel number in the image as was 
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Eun before in Fig. 4-2 where j = NMAX (n-1) +m; i is the 
Endex describing the location of the input samples in the 
Search box as in Fig. 4-2 where i = MSB * ( n-1) + m. 

The input signals are multiplied by the nonrecursive 
Iter coefficients Wi,W5.. «Wr and then summed together as 


Eun in Pig. 7-1. 


input 
Signals 

Filter 
Coefficients 





πο. 


Mec eneral filtering configuration is given in Fig. 7-2. 

In the following, an adaptive method will be presented to 
mec the filter coefficients Wa MW to achieve an optimal 
estimate of a known signal. It will be shown that at steady 
state the filter coefficient will approach the Wiener filter 
Coefficients. A review of the adaptive filtering formulation 
based on references 21, 22 will be presented in Appendix C. 

ΙΝ. algorithm derivation is based on the following model. 


EN P)ven pixel, the output of the filter 15 
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Let us select a desirable reference performance, 45 
MEN we seek to achieve at the steady state. For example, 
in the case of point target detection (or estimation), we 
Meek tO achieve the best estimate of a point target while 
suppressing the background clutter noise as much as possible. 
Memilarly, in case of line target detection (or estimation), 
EN -ἱ to achieve the best estimate of a given line while 
Apr essing the clutter noise. 


MINUS define the error e ADS Oca ton Ἱ το σε 


T 
E. = d.- y. = d. - WX. 7-4 
Y j j Ces) 
It is the purpose of the adaptive process to adjust 
the weighting coefficients of the linear adaptive filter 


to minimize the mean square error EE 


In this chapter we will make the assumption that the 
EESTI noise is stationary. In the following chapter, a 
method will be suggested to deal with nonstationary clutters, 
Ere the statistical properties can be assumed to be 
Beationary only within a small area. The detailed adaptation 


method and derivation are explained in Appendix C. 


SS 





D. TWO DIMENSIONAL ADAPTIVE FILTERING CONSIDERATIONS 


I Introduction 


Mts section, '"non-optimal' spatial filtering 


Will be described to introduce the need for adaptive filter- 


EE FOr this purpose, 


BueuesEcemubstedeimage is used 


meen Consists of four subimages simulated by computer and 


Seppe 1Our different statistical correlated noise charac- 


Beristics as shown in Fig. 


Upper left quadrant: - 


Mower right quadrant: - 


mower left quadrant: - 


Lower right quadrant: - 
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EN ΙΙ the statistical properties of each quadrant, optimal 


spatial MMSE filter can be designed as follows: 


Men Upper left quadrant: 


πο το iS 
NÓ 10 O 
ee Fu = 


Horcupper right quadrant: 


5 -.6 no 
-.5 AN =.5 
1:5 -.6 S 
For lower left quadrant: 
36 -.6 36 
-.6 220 -.6 
5-6 50 


mom lower right quadrant: 
24 -.487  .24 
.499 1.0 .499 
2053 - hd 7 245 


However, Fig. 7-4 shows the filtered image by using only one 
Spatial MMSE filter optimally designed for the upper right 
quadrant but applied throughout the whole image. It should 
pointed out that a threshold was applied after the spatial 
Biltering to obtain Fig. 7-4. It can be seen that excellent 


"clutter noise" suppression was accomplished in the optimal 





Filtered and Thresholded Image 
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Probability of false alarm is 0.1462. 
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false alarm] 
Four Quadrant "Nonstationary" Clutter Image. 


computer Printo 


-4 


‘igure 7 


V 





Meter quadrant. Considerable amount of clutter noise 
remained in the other three "suboptimal" filtered quadrants. 
It would be desirable if an adaptive algorithm can be devel- 
EMEN So that the filter coefficients will be adaptively 
@aanged to new optimal values when the filter is moved into 
Excess having different statistics. 

An example of such an adaptive filter configuration 
EN Ucwn in Fig. /-5. Similar to all other spatial filters 
EN doped in this thesis, it uses a 3x3 search box. Signals 
Ot all nine pixels in the box are weighted and summed to 
MEE estimate of the target signal at the central pixel. 
E Uer. there are two major differences. First, the weight- 
ENcoefficients are adaptively changed by a feedback proced- 
MESAS shown in Fig. 7-5. At the beginning, nonrecursive 
meat filtering is carried out as described previously. 
The processed target signal, Yoo is now compared with the 
selected desirable reference target, Zr by subtraction and 
Meoauces an error signal, Ej This is then multiplied by the 
Meemecivye loop gain constant, u, and then by the nine corres- 
Memes Unprocessed signals, X, to process a correction 
ENEhting coefficient, AW; , ο τα, orre ponding Coefficient, 
E Mine new filter coefficients, a are used to perform 
w Step of spatial filtering and generate an additional 


ΠΝ. Oof corrections to the filter coefficient. Then the esti- 


mation pixel is moved one pixel, a new set of unprocessed 
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Eure 7-35 Configuration of Adaptive Two Dimensional 
Bnncenssive spatial Filter. 





Meals, X, is read out and the adaptive filter process is 
repeated again. This adaptive process is repeatedly carried 
@ateaccording to the process described in Appendix C and 
Esed-on the LMS adaptive algorithm, equation (C-42), until 
the steady state optimal solution is reached. The second 
w erence of this adaptive spatial filter from the non- 
Beapcive spatial filter is in the scanning pattern of the 
ematıon pixel. It is not the conventional raster that 
E Nestimation pixel is moved back after the completion of 
each row and is always scanned in the same direction. Instead, 
Meter each row, the scan direction is reversed as shown in 
NO... The reason for this successive reversal of scan 
direction from one row to the next is to insure that the 
MATEO statistical characteristics of the clutter noise 
ΝΙΝ Τιπτζεὰ because in this new scan motion the estimation 
Eel is moved only by one pixel. 

Meme details on the implementation of adaptive spatial 
ts Ts will be developed in the next section. 

Detailed Implementation of Adaptive Spatial Filter 

Several aspects of adaptive spatial filter implemen- 
mation are described in more detail in this section: 

na se scanning pattern 

e mina tion ot filter coefficient adaptation 

raro. 0 desired reference = 


'. eleetion Of adaptive loop gain U 
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e. Required number of independent pixels to achieve 
adaptation 


áa. ine Image Scanning Pattern 

Several image scanning patterns were tested. 
Nue 7-6 presents two possible scanning alternatives. 
Marine the scanning pattern of Fig. 7-6(a) to that of 
7-6(b), it was found that using the pattern of Fig. 7-6(b) 
Παρ the filter did not yield the optimal filter coeffi- 
ου πι. This scanning pattern introduced an artificial 
transition at the end of each row and therefore affected the 
πα, process. On the other hand, the pattern of Fig. 
Bea) offered a smooth adaptation without these artificial 
EEUSTtIons and the resulting adapted filter coefficients 
Mete” tound to be the optimal. 

DN algorithm for Termination of Filter Adaptation 

several algorithms were tested for termination 
ENIIter adaptation. The selected algorithm is based on 
EN lowing steps and its flow chart is presented in Fig. 
m7. 

(1) Test the MSE at each n^ adaptation step. 

Ee ep track of the lowest MSE = MSE in 9) 
Ets corresponding filter coefficients. 

ουσ N~ (N>>n) adaptation step whether 


the new MSE, ; - MSE an) is smaller than MSE (0) by a 


AA min 


ON are constants that can be selected either by simu- 
won or arbitrarily, as recommended later on. 
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Figure 7-7. Software Algorithm to Terminate Filter Adaptation 
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Memtain factor F (say, 5%). If smaller, then continue, else 
terminate adaptation. Other algorithms based on monitoring 
EEUU ter coefficients error or continuous tracking of MSE 
EN Lt term observation) did not yield satisfactory results. 
The suggested algorithm was tested in various simulated images 
and it functioned well whenever the parameters F, N, n were 
selected properly. When absolutely no a priori knowledge of 
noise statistics is given, these parameters can be selected 
Mepeene worst case: for example, n = 36; N = 360; F = 0.1%. 
Meet some statistical data is available, these parameters 
ο δε optimized to hield fastest indication of adaptation 
Euunation. The information about adaptation termination 
as necessary mainly for the following two purposes: (1) an 
attempt to filter the image before reaching the steady state 
Bon will yield poor noise suppression; (2) in Chapter 
ENS particular application of the adaptive filtering 
Bechnique will be presented by dividing the image into many 
ENumages and adapting a different filter to each subimage. 
Er such circumstances and when only one central processor 
EN Sslable, it is important to detect the adaptation ter- 
Mamation in each subimage before moving to the next subimage. 

Ehe Derivation of the Designed Response, d 

To derive the desired response, E let us return 


NE LMS adaptation algorithm presented in eq. (C-42): 


170 








W. SW Ε--ᾱΔ. 
j ἘΠ 5 OT 


is = 2 ° = 9 - Q 
met, N, (7-5) 


where AW; is the filter coefficients correction vector at 
Meapcion step j. πη σε the error equation (C-2) 


EMO (7-5) will yield, 


T 
Bd. Ww.*X.):X. 
NE ; 3^ 55 di 
AW. x 
I Je = 0X.) +X. AO 
A*Y a (4, W Xi) X; (7-0) 


BT presents typical 3x3 spatial filter and the corres- 
ponding input samples for various target types. 
pomonsuaNsMbackoto eq. (7-6), let us expand the 


MA tor the simple point target example of Fig. 7-8(a) 


AFW = Χι([Χηνη * ΠΕΣ * S)W- E Eu a 
AFW = (x¿+S) 1 [x,w, + (X; + AE * ΠΣ - 5) 

; (7-7) 
A*Wo = Xo{ [x] w] V OT (x; + S) Ws * e XoWo] - 5] 


Where s is used twice on this configuration - once as the 
desired response ο, and once as an injected signal - injected 
mnr icially to sample Xc. 

As mentioned earlier, the adaptive process acts 
Eu low pass filter smoothing out equation (7-7) to yield 


lts expected value: 
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E [Aw] " E[xyxi] ", ”.. Ε[Χικε]πς *.. E [X1Xg] wg 


H 


ΒΑΝ E[xex4]wi v E[x¿x¿]ws = E [XsXg] wg 


* E[s:s]wz - E[ (x« ο 


o) 
E[ AW] = E[X9X,]w, + Elxgxslw; + ..E[XoXg]Wg 


Assuming the signal s and the noise samples X are uncorre- 


lated. At steady state E ο will be zero and 


E (7-8) can be rewritten in the vector TOTH, 
[Run n Ros) W = P (7-9) 


Assuming the input samples X consist only of noise and the 
Meet is summed artificially to X. 


RNN = cov [noise] 


Ros cov [target] 


P 


era correlation vector given by eq. (C-5). 
Eq. (7- 9) is indeed the Wiener filter equation for a point 
target. We can proceed in a similar way to construct = for 
Sener Simple type targets. 

Let us summarize the steps of deriving the = in 
w patial adaptive filter configuration: 

Ie target shape should be drawn with respect 
Meetne search box dimension. 

EE UNE uc vector" locations through which the 


Bareet will pass will be "marked" to establish a reference 


mor, D = [d,d,...d 


132 ii: All the "marked" locations, d 


n 


43 





ENNUbe set to s = signal desired level, and the remaining 
Bcatıon will be set to zero according to the shape of the 
ες ος interest. 

3. While adapting the filter coefficients, it 
is assumed that relatively few pixels contain the target. 
An even more reasonable assumption can be made for practical 
imaging systems, considering the total absence of the external 
target during the initial adaptation phase. Making this 
EE son will require a preliminary "learning" period prior 
utilizing the filter. Under this assumption the referenced 
vector D may be summed together with the input sample vector, 
ENS resulting outcome will be applied to the filter to 
Ed 1ts output, E 

x: he output, Y; will be ' subtracted: from the 
referenced signal ὃς se signal level) te yield the error 
signal. 

P hen ror signal multiplied by the loop gain, 
m be thus multiplied by each of the input vector (X+ D) 
ents to yield the correction vector, Aw. 

Be Steady state after many adaptation steps, 
EEUI will approach zero and the Wiener filter solution wili 
be reached. 

Ie corresponding "Adaptive" Matched Filter 

It was mentioned earlier in this work that the 
Selected major goal is to detect point targets. It is inter- 
esting to note the correspondence between the adaptive Wiener 


filter for point target enhancement and its counterpart - the 
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Med filter. Referring back to eq. (7-8), let us select 
E OUbe extremely small compared to the input noise samples. 
Mader this condition, eq. (7-9) will become 


RuyeW = P ESOS 


5 
NEU. the non-zero term of ἃςς Ξ(5.) 15 very small compared 
to E[xex«c]. ΠΠ ΓΟ matched filter derivation that 
Mie Matched filter solution is given by 


απ - ο οι 


ο τς C is a constant and S is the signal vector. In the 


mse OL point targets, both P and S will be in the same form. 


p 


ιν SD] 


5 O 0] 


ce we can select the constant C arbitrarily, selecting 
Meena Will cause eq. (7-11) to be identical to eq. (7-10). 

Dean terıcal Implementation method to adapt the 
corresponding matched filter was performed in this work as 
Ene following: 


Go p) tONsarysteedguation (-199- 


il Select ος 

2. Since the constant C may be selected arbitrar- 
EE cand likewise, one of the filter coefficients can be 
EN ted arbitrarily, the estimation point coefficient was 
selected to be 1.00. Resulting simulated adaptation plots 
EN be presented in this chapter. This modified Wiener 
Enter coefficients adaptation curve, when compared to the 
M@eoretical matched filter coefficients, shows excellent agree- 


Ment. 


TeS 








ΟΠΠ. ΠΕ matched filter discussion, let 
Ms note that for the case of point target enhancement a 
Meaiiied adaptive Wiener filter will yield a corresponding 
matched filter. For targets other than point targets, in 
many practical cases we can find a corresponding matched 
MS counterpart. This issue is beyond the scope of this 
work and will not be pursued any een en 

Beine selection of the Adaptive Loop Gain, μ 

Appendix C, section C. presented few factors 
EE τὺ the selection of the loop gain. The first is the 
EE Uustment, given in eq. (C-63), and the second is the re- 
eted convergence time constant given in eg M oT SA more 
EIUS) parameter related to u, is the stability of the 
Eptrve loop. 

"ΤΙ: ΙΙΙ we subjected the processing 
E orrthm to the assumption that no a priori knowledge 15 
Meanlable. Based on this assumption, an appropriate auto- 
EE cain control ('"AGC") was needed. Various gain control 
loops were tested and the selected configuration is presented 
METE. 7-9. The "AGC" loop major design requirements were: 

e ea al possible reasonable initialization 
ΙΝ. ter coefficients (W_) loop stability has to be Ee 
(selection of LN mous be avoided in any case). 

Ian external selection of loop gain 
Benstant, C, the loop should not diverge (avoid overflow). 

Steady state misadjustment, independent 
background noise statistics, should be the same and should 


me controlled externally. 
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4. Subject to the above stated requirement, it 
ENeqguired to control the gain so as to yield the shortest 
EDrtation time constant. 

The following measures were taken to satisfy the 
listed requirements: 

Mo rder to avoid divergence of the filter 
ΝΠ. τις under any circumstances the output y(m,n) is limited 
to a selected maximal value. 

In NoONder to'assure a constant 'misadjustment' 


E Utotal input power in each input sample set, has to be 


J: 


trace Αγ 


EE uIred since the misadjustment is given by: 


ENCHulated to get the estimate of ( ee bits ees Elma te 


M = u* [trace- Re]. 


1 


trace Sex 


EEUonal constraint is imposed on the trace measurement: 


While estimating ( ΠΟ; Aj» A, Az O IO 


uc 


ισα 


G, (k) x4 + [xol Ge 


iz 
ENEUP filter adapts its coefficients, the output y becomes 
B 


MSN small compared to 11111 audeas pcc mE αυ ρα 


EN Udabtion steps, if indeed convergence is achieved, 


Berindicated in Fig. 7-9,. the gain constant C can be set 
EN rnally. Therefore, in extreme cases when a high C is 


selected, by mistake or intentionally, the second term in 





eq. (7-12), namely, |y(k)|, will assure the gain convergence, 
ENprevent loop divergence. 

As the filter converges, the trace estimate 
becomes less noisy due to the smoothing operation done by Az. 
Mrentually, after a few hundred adaption steps, the loop gain 
e stable and can be locked to its last value, as demonstrated 
Meerig. 7-9 by the memory, Ag, and ene Switch, SW1: 


', π᾿ τς AGG’ configuration presented 


Beer - 9, the misadjustment is indeed constant under all 


1 


ec Ry y 


MS tment given by (C-65) is M = μ.ο ττ Rex = "0 “(eons tant). 


aia 


wS tances since the loop gain u = C andthe mis 


we in Appendix C, section C, the adaption time constant 


Was calculated as well and was given by (C-67) (for equal 


eigenvalues). 
cae MR 
E enh ie 
| | I : 
For unequal eigenvalues, 7 1ο related to = butin 


mse C 


more complex form. 

Γι τοι ο ents “AGE” configuration could yield 
Mer Tequired performances, for a proper selection of the 
constant C. For example, a misadjustment of 10% can be 
Meeured by selection of C = τὸ Iu gno mml]ssesubt ma 
given adaptation time. 

In order to accelerate the adaptation period, a 


gain switching option was tested such as demonstrated in Fig. 


7-9 (b). In the gain switching case, an initial gain constant, 


u 








| as high as possible, is selected to achieve a fast conver- 
gence toward steady state. After a certain number of adap- 
EUH steps, the gain constant is switched to a low value to 
Eure the proper required misadjustment. When some a priori 
mmowledge is available about background noise statistics, the 
gain switching point can further optimize the performance. 
res zazelear trade off that limits the util- 
ization of the gain switching method. Whenever the initial 
Mess, Wo Memes initial filter coefficient) is close to the 
Mmmeoady State solution, applying the gain switching technique 
Will not be fruitful and sometimes will even be the worst. 
Ene other hand, when initial guess of W is assumed to be 
wom the steady state solution, the gain switching tech- 


QUe will indeed shorten the adaptation time, 


f. The Required Number of Independent Pixels to 
το. chrieve Adaptation 


Hieowniole all the preceding discussion the image 
statistics were assumed stationary. If one assumes that the 
arity is confined to limited image subzones, the 
Mne filter input samples should be confined accordingly 
Mia subzone. The question raised 1S, what is the minimum 
Múmber of independent pixels sufficient to achieve filter 
adaptation? Intensive computer simulation indicated that 
.π..! XS filter size a subimage of size 6x6 is sufficient 


EE dapt filter coefficients. It was noticed that adaptation 
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rate is slowed down as the number of independent pixels is 
EEuced. Simulation results for small size image filter 


Mp tation wili be presented at the end of this chapter. 


COMPUTER SIMULATION RESULTS 
introduction i 
ENS section typical computer simulation results 
will be presented. The type of filter selected to be presented 
Ea spatial IS ze filter, Optimized to enhance point 
targetsand suppress correlated noise with variance E 2.0. 
E crollowing plots will be shown: 


Meee tilter coefficients adaptation plots, compared to 
Mae theoretical coefficients. 


Meee learning curve (MSE as a function of adaptation 
EDS). 


e e radient estimate curve as a function of adaptation 
steps. 


Mess imulation procedure was conducted in the following way: 


Generate the correlated noise image with specified 
Mis tical properties. 


EN USpt the filter coefficients. 


C 


Design a theoretical Wiener or matched filter based on 
known Statistical properties. 


a. Plot the coefficients adaptation curve compared to the 
EU Uretically designed coefficients. 


Meee sets of adaption plots will be presented: 


EN Adaption of the spatial filter to an image with first 
meager Markoy model statistics. 


2. Adaption curves for second order Markov model clutter. 


=æ 


3. Small size image adaptation curves. 





EE Adaption to Frese Order Markov Model 


A LO Presents the Unprocessed clutter image 
Menmerated by first order Markov process with correlation 


factor 
= 0.99 


Τη 
The theoretical filter coefficient and the steady state 
Adaptive coefficients are shown as well in Fig. 7-10. 

ο l(a), (b), (c) presents the filter coefficients 
τση curves as a function of adaptation steps. The 
m@eoretical coefficients level is presented as well in each 
MO tation curve and 1t is seen that the adaptive filters 
MENS cilents come indeed very close to the theoretical value. 

muc 11 learning curve and it shows the MSE 
EN cer output as a function of adaptation steps. 

Pi Ss Shows the sum of the absolute values of all 
meetricients correction signals. 

EN Adaptation to Second Order Markov Model 

Τι: Επ5 unprocessed clutter image 
generated by second order Markov process with correlation 


factor 


Ory Py = 0.95 


Ama spatial frequency 


By Sy DOS 
Mmemeheoretical and the steady state adaptive filter coeffi- 
πι» are shown as well in Fig. 7-14. 


A a 0), (c) are the filter coefficients 


E ration curves. Fig. 7-16 is the learning curve and 
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The Unprocessed Image 
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Unprocessed Image and Filter Orientation 
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MEN 7-17 is the sum of the absolute values of all coeffi- 
EEeHnts correction signals. 
4. Adaptation to Small Size Image 

ΤΙ is the Unprocessed first order Markov model 
Butter image. A section of 6x6 pixels is selected as shown 
Meo. 7-18 to adapt the filter coefficients. The adaptive 
meopcess is accomplished within this small size section. The 
wne filter coefficients adaptation curves are shown in 
| E /-19{a),(b),(c). The learning curve is shown in Fig. 
7-20 and the sum of coefficients correction signals is shown 
EP. 7-21. 

simulation Results Conclusions 

Ma Or computer simulation results conclusions are 
Mescribed below. 

- The adaptation rate decreases as correlation 
w icient increases. 

- An impirical relation was approximated to indicate 
ΝΠ. τα] number of adaptation steps Nl(total), as a function 
of Oy OT Py and 3 ΟΥ θυ. 

τ ἔπε tirst order Markov process: 


2 


] 


where n lace hyseher correlation coefficient 


Na (@otal) = K, [1.0 - ou D 
(between Og and oy). bao os ty, Ky S 250 - 500, depending on 
NOD gain constant. 
- For second order Markov process, the following 


approximated empirical formula can be used: 


ιο. 
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ο πα NE total)*[(1+1l/cos O 


E. is the higher 8. 
NEU 2eneral> it Was noticed that the adaptation 
Meee is SlOwer in the second order Markov process than in 
the first order Markov process. 
- The adaption time of a small sized image is slower 
compared to larged sized image (by large image it is meant 
Mat the image size is very large compared to the search box 
Size). 

- A complementary study with regard to suboptimal 
filters was carried out in the study phase presented in 
Ehapter VI. One of the conclusions there was that a sub- 
ESL filter designed to operate in the presence of highly 
ete bated clutter is the preferred suboptimal filter. Com- 
meme this conclusion with the fact that adaptation time is 


En case of high correlation - it is always recommended 


to select the filter initial value as if it were designed to 


EE. with the highest correlation factor. 


I SUMMARY 

cis Chapter a spatial adaptive filter concept was 
discussed and implemented. The adaptation method presented 
Meche Chapter is applicable for enhancement of targets of a 
mayen Shape cluttered hy highly correlated noise. 

EN Ud)tion, a practical method to modify a special Wiener 
Meter - intended to detect point targets - into a matched 


filter was presented. This method enables a direct adaptation 


T90 








EN Unastched filter in the case of point target. The 
suggested method was tested against simulated images and 
demonstrated the expected performance - namely, the adapta- 
MONO the filters into a steady state optimal solution. 
Various practical implementation issues were mentioned 

the chapter such as: 

- The image scanning pattern 

- The "desired response' derivation 

Meine adaptive loop gain setting 

ene typical adaptation rates 


" The required number of independent pixels. 


This last issue will be utilized in the next chapter 


where nonstationary statistics will be assumed. 
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Ἱ CEESDAPTTVE SPATIAL FILTER II - 
NONE ELONARY CLUTTER STATISTICS 
fee INTRODUCTION 

ENDS chapter, an adaptive spatial filter technique 
capable of processing images having nonstationary clutter 
will be developed. Its basic idea is described in the fol- 
Mins. More detailed explanations will be given in following 
sections. 

The first assumption is that an image of nonstationary 
Metter statistics can be divided into subimages within which 
M@emeiutter statistics are stationary. 

w al filter will be assigned to each of these sub- 
οὓς. An adaptive algorithm is then applied to adapt the 
wened filter to its optimal performance. An automatic 
procedure is applied to terminate the adaptation. The optimal 
meter is then applied to the subimage. 

meebowing this, an optimal threshold will be determined 
Miceapplied to the adaptively filtered subimage for target 


detection. 


B. THEORETICAL DEVELOPMENT AND PRACTICAL CONSIDERATIONS 
me oubimage Division 
ντ thesis, a procedure of dividing the image 
Mito square shaped small subimages is developed. From the 


processing gain requirements, the smallest subimage size is 
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ΜΙ. τὶ because the chance is better to have "stationary" 
Meacistics in a small area. This makes possible the design 
Mean Optimal spatial filter. On the other hand, smaller 
παρε size requires more adaptive filters to cover a given 
Mage size and increases the computation load. A trade-off 
should be made for an optimum subimage size. The smallest 
Size used is 6x6. Using this small size and simulated images 
containing Markov model correlated noise, it was found that 
Bae adaptive filter was able to converge to the optimal value 
E cases tested. 
EN Sdaptive Spatial Filter 

For each subimage, adaptive spatial filters developed 
Ene last chapter can be used because we assume that the 
EU Ustical properties in the subimage are stationary. There- 
fore, detailed explanation for the adaptive spatial filter 
πμ... τος Ρε repeated here. Instead, only the important steps 
EU be highlighted in the following. 

ta lization of the Filter: Coefficients 

Ma can be started in two ways. We can assume 

ΠΜ, ristical characteristic and design a spatial filter 
EE Uingly. Alternatively, we can calculate the statis- 
E characteristics of the image by ignoring the nonsta- 
νιν which might exist in the image and design a spatial 


EE accordingly and use it as the initial filter. 
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Bess oeclection of Adaptive Loop Gain 
ο ο ο δποσσα in detail in Chapter VII, section 
EE In our computer simulation, a loop gain of 0.4 was used 
Est frequently. 
EE Termination of Adaptation 
M procedure tO terminate the adaptation was 
EECuUussed in Chapter VII, section G.2. In our computer simu- 
lation, the following parameters are used: 
πο το N = 300, FE = 5$ 
d. Adaptation Time 
Pe pends on the following factors: 
EN er Initialization 
Adaptive loop gain 
Statistical characteristics of the image. 
ΠΝ. 51 factor is beyond the control of the filter designer. 
EXVer, design of the initialization and loop gain could have 
EEUEnificant effect on the adaptation time. It was found, 
from computer simulation, that using a loop gain in the range 
1 


of i to 5; it took at most several thousand adaptive steps to 


En the optimal filter in most cases. 


COMPUTER SIMULATION RESULTS 
l. Generation of Nonstationary Images 
The nonstationary image used in this chapter is the 
meme One introduced in Chapter VII, section G.4. It is an 
image of size 64x 64 pixels, and consists of four 


m@eeaarants, each of which has its own statistical properties. 


200 





cy are separately shown in Figures 8-1 through 8-4, 
include their statistical properties and optimal spatial 


Meters together with the theoretical processing gain of these 


filters. 
En 3-lI Upper left quadrant 
ο ZZ Upper right quadrant 
Fig. 8-3 Lower left quadrant 
"0:1 Lower right quadrant 


Mier composite nonstationary image is shown in Fig. 8-5(a) 
στα level printout and in 8-5(b) by a 5-D plot. 
ENmage subdivision and Filter Adaptation 
The image is divided into square shaped subimages of 
EN USXx8 pixels, as shown in Fig. 3-6(a). An adaptive filter 
Was assigned to each subimage and was adaptively changed until ' 
it reached the optimal performance. In Fig. 8-6(b)the adaptive 
filter coefficients of several selected subimages are shown and 
we compared with the theoretical optimal filter. The 
ing processing gain and optimal threshold are shown in 8-6(c). 
The threshold was determined by assuming Gaussian probability 
END" function, and for a probability of false alarm in the 
range from 1x10 | = Pon SEES 
Comparison of Filter Performance 
Ehe following figures of merits are used to evaluate 
the filter performance. 


ne lutter suppression: 


w Processing gain (P.G.) 
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Three Dimensional Plot of the Computer 


Generated Upper Right Quadrant Image. 
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3-D Plot of Lower Left Quadrant 
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Computer Print and Statistical Properties of Lower Right Quadrant 


Image and Its Optimally Designed Spatial Matched Filters. 
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Figure 8-5(a) Nine Gray-level Computer Print of Four Quadrant 
Nas ras ionary  Ssimulated Clutter Image. 
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Figure 8-6(a) Division of a Given Image Into Subimage 
Zones tor Pertorming Filter Adaptation. 
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Figure 8-6(b) Adapted Spatial Filter eoertieientsscor Each 
8 by 8 Pixels Adaptation Subimage πε. 
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Processing Gain and Threshold Level in Each Subimage 
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τπτ οη point in the inner sectors is in the 
oreh box center. 


Figure 8-6(c) Processing Gain and Threshold Level for 
Each 8 by 8 Pixels Adaptation Subimage Zone. 





For target detection: 
Dee rOpDabiality of detection "e 
-ProbabrPrity of false alarm (Pra? 
Sets of comparisons will be presented. 
meron Background Clutter Suppression 

Mores tt sets to Compare adaptive and non- 
Ee filters in terms of background clutter suppression 
m@@eprobability of false alarm. It consists of five figures. 

Fig. 8-7 shows the adaptively filtered and thresh- 
olded background clutter image, using a subimage size of 
Meepaxels. The resulting probability of false alarm is also 
πει in Fig. 8-7. 

en S S shows nonadaptıvely filtered and thresh- 
olded background clutter image and consists of four figures. 
Enc $-sS(a) is the result using the optimal spatial filter 
Mesaened for the first quadrant. Figures 8-8(b), (c) and (d) 
Me the corresponding results using spatial filters optimally 
Mmeotetied for the second, third, and fourth quadrants respectively. 
Probabilities of false alarm for each case are also listed in 
these figures. 

Compar ine Fie. S- 7 and Fig. 3- 8 revealed that the 
Exbsbility of false alarm of the adaptive filter case 15 
about 22 times lower than that of the nonadaptive filter case. 

The second set of comparisons is similar to the 
Et set for comparing clutter suppression and Pra: However, 
mre adaptive spatial filter in this set used a large subimage 


mee or 16x16 pixels. Only three figures are used. 
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THE ADAPTIVELY FILTEREC IMAGE 
F? OBAR IL ITY OF FALSE ALARM IS 0.0066 


Figure 8-7 Computer Print of False Alarms of Adaptively 
Filtered and Thresholded Four Quadrant 
SNometationary' Simulated Clutter Image. 
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Figure 8-8(a) 
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PROBABILITY OF FALSE ALARM IS 0.1462 


Computer Print of False Alarms of Nonadaptively 


Filtered and Thresholded Four Quadrant "Non- 


mreure 8-8(b) 


xao Simulated Clutter Image Using Spatial 
O) tilmaliy Designed tor second Quadrant. 
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PROBABILITY OF FALSE ALARM IS 0.1596 
Figure 8-8(c) Computer Print of False Alarms of Nonadaptively 


Dee redsand Thresholded Four Quadrant “Non- 


onc c»emulated Glutter cImsge Using Spatial 
Filter Optimally Designed for Third Quadrant. 
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EUSPABILITY OF FALSE ALARM IS 0.1555 


Figure 8-8(d) Computer Print of False Alarms of Nonadaptively 
Fulterea and Thresholded Four Quadrant "“Non- 


ορ Simulated Clutter Image Using Spatial 
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Filter Designed Optimally for Fourth Quadrant. 





Lucus -o Shows the adaptively filtered and 
Ehresholded clutter image and its Pea: 

ορ ο Umecomnpares the performance of adaptive 
filters using 8x8 and 16x16 subimage areas. It can be seen 
Mat a Smaller subimage size offers better results. Figure 
EU indicates that in 7 out of 16 (43%) subimage areas of 
MeeeeoOxX 16 a transition in the statistical properties occurs 
miside the subimage area. On the other hand, Fig. 8-6(c) 
Endicated that in the 8x 8 subimage areas the transition in 
Mes statistical properties occurs only in 15 out of 64 (23%). 


his difference explains the improvement in the P as sub- 


FA 
Image areas size is reduced. 

Figure 9-11 shows the nonadaptive filtered and 
thresholded image using a spatial filter optimally designed 
ο πε lower right quadrant. The resulting PEA ls also 
σα in the figure. 

Comparine figures 8-9 and 6-11 revealed that the 
Pra {πε adaptive filter case is about five times lower 
Maan that of the Monadapeive filter case. Ihe difference 15 
EMEN bis as a factor of 22 for the smaller subimage size 
Base shown in figures 8-7 and 8-8. 

INE Or Clutter Suppression and Target Detection 

ον ινα τοι of comparısons 15 Tor both clutter 

Banpression and target detection. For this purpose, an en- 


Me of point targets shown in Fig. 8-12 are added to the 


clutter image. The resultant image is shown in Fig. 8-15. 
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THE ADAPTIVELY FILTERED IMAGE 
PROBABILITY OF FALSE ALARM IS 0.0078 


Figure 8-9 


Computer Print of False Alarms of Adaptively 
Filtered and Thresholded Four Quadrant 
“Nonstationary" Simulated Clutter Image. 
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Figure 8-10 Processing Gain and HE o Level for Each 
16 by 16 Pixels Adaptation Subimage Zone. 
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eae TARGETS TOGETHER WITH BACKGROUND NOISE 


Figure 8-13 Computer Print of Four Quadrant 'Nonstationary" 
Simulated Clutter Image Including Added Point 
Targets Shown in Figure 8-12. 
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The target intensity is proportional to the threshold level 
at each subimage zone. 

Figure 8-14 presents the adaptively filtered and 
thresholded image in which all false alarms have been removed 
BO that the probability of detection can be calculated. It 
æ included in the figure. 

Figure 8-15(a),(b),(c),(d) present the nonadaptively 
filtered and thresholded image using spatial filters designed 
Optimally for first, second, third and fourth quadrants respec- 
tively. Resulting probability of detection for each case is 


included in corresponding figures. 
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THE ADAPTIVELY FILTERED IMAGE 


Eure 8-14 Computer Print of Adaptively Filtered and 
Thresholded Four Quadrant "Nonstationary" 
Simulated Clutter Image Including Added 
Point Targets. 
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PROBABILITY OF DETECTION IS 0.731 


Figure 8-15(a) 


Computer Print of Nonadaptively Filtered and 
loc nosu coc hour Quadrant "Nonstationary™ 
oimulated Clutter Image. Spatial Filter Used 
ΠΕΠ; Tor ine First Quadrant. 
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EMISBABILITY OF DETECTION IS 0.807 


Figure 8-15(b) Computer Print of Nonadaptively Filtered and 
PB onsbdged. Pour Quadrant "Nonstationary" 
Simulated Clutter Image. Spatial Filter Used 
was Designed Optimally for the Second Quadrant. 
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Figure 8-15(c) 
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EESSDABILITY OF DETECTION IS 0.694 


Computer Print of Nonadaptively Filtered and 
Dieesnolded Four Quadrant ‘Nonstationary 

Simulated Clutter Image. 
was Designed Optimally for the Third Quadrant. 
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Spatial Filter Used 
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PROBABILITY OF DETECTION 


Figure 8-15(d) 
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ΕΠΙ Four @uadrant “Wonstationa ry" 
ΠΤ: Clutter Image, Spatial Filter Used 
was Designed Optimally for the Fourth Quadrant. 








D. SUMMARY 

An adaptive spatial filter algorithm based on least mean 
mace Criteria and using a steepest descent technique is 
miown to be effective in suppressing nonstationary clutter 
Based ON Computer simulation of Markov model clutter noise. 

IK -Evorobability of false alarm of the adaptive filter 
NES lower than that of nonadaptive filter case by 5 to 
times for the examples used in this study. 

IN o "cbabrilrty of detection of the adaptive case is 
Slightly better than that of the nonadaptive case when the 
ποιά level is kept equal for both cases. It must be 


Enphasized that Pe tor the nonadaptive case 1s 5S to 22 times 


A 
er. On the other hand, if a CFAR detection is applied 
ENSdgusting the threshold for the nonadaptive case, severe 


meduction of Pa "adds Scc. 
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IX. SUMMARY AND CONCLUSIONS 


A. SUMMARY 
I Introduction 

News iniraned surveillance and guidance systems using 
END N55ajc detector array focal planes require the detec- 
woe targets deeply buried in background clutter noise by 
Ead tens of db's. New image processing techniques must 
be developed to accomplish these heretofore unachievable goals. 
Maeve must also be relatively straightforward so that on-board 
BUementation using moderate LSI signal processors is pos- 
Mme tO meet real time processing requirements. They should 
EE cube flexible enough so that a focal plane processing 
EE t:Hn is able to adapt itself to changing background scenes. 

foes thesis develops five focal plane processing pro- 
ού which consist of nonrecursive statistical filters for 
background clutter suppression followed by thresholding to 
initiate the target detection.  Nonrecursive approaches are 
pen because they make extensive use of both the spatial and 
temporal behavior of the image signal in the neighborhood of 
m@empixel of interest. On one frame of the image, signals 
eis all around the pixel of interest are used. In 
Merton, Signals at the same pixel location from other frames 
before and after the frame of interest are also used in the 


focal plane processing. New integrated circuit tapped delay 





line devices may be used effectively for their hardware 
lENNementation. Statistical approaches are used because it 
1s believed that a, collective statistical description can be 
found for different background scenes if they belong to the 
same class of terrain, weather conditions, etc. Therefore, 
ENS possible to design a statistical filter which is able 
to estimate a weak target buried in noise and is not limited 
to only a few background scenes. 

BHocmencept of using nonrecursive statistical filters 
EN 5cekscround clutter suppression was originated by Lt. D. 
Bar-Yehoshua [14] in nis development of nonadaptive spatial 
Mes based on the minimization of mean square error. This 
thesis made extensive extension and more thorough developments 
Of four nonadaptive filters in both spatial and temporal do- 
ENS in addition, a new adaptive spatial filter is developed. 

I Nonadaptive Focal Plane Processing 

lu uxpter IT, the basic Concept of the monrecursive 
Statistical filter is expandea and generalized to include all 
nonadaptive and adaptive, spatial, temporal and mixed spatial- 
ο οτα] or temporal-spatial filters. A unified processing 
Bencept is presented for clutter suppression based on the 
Statistical spatial and temporal behaviors of the image in 
mmemneighborhood of the pixel of interest. Two statistical 
Steria for filter design are introduced. One is based on 
the minimization of mean square error criterion which leads 


to the MMSE filter or Wiener filter. The other is based on 





NE ONaximization of signal to noise ratio criterion which 
Meads tO the statistical matched filter. 

Detailed developments of the principles, configura- 
tions, and design procedures for the rilters are developed 
ιν. τετ 111 for spatial filters using a single image 
meame and in Chapter IV for sequential spatial-temporal 
EN asing several frames of images. These three dimen- 
Eus Statistical filters are useful in situations when 
multiple frames of images are available, either when the 
Ema lance and guidance systems are already in their track- 
ο. προεςς after the targets have been acquired or when the 
Millas of view of the systems are stabilized to cover an 
mea for a number of frames. 

E naper V the thresholding procedure for a two 
... οπαὶ image is developed tor the initialization of 
Mameect detection. Two CFAR (constant false alarm rate) 

EN 1655 to set the threshold level are developed. One 
EN τ Gaussian probability density functions. The other 
EN cr the more general non-Gaussian PDF. 

ον πα τσ the "background clutter suppression 
NEU Crs and thresholding are combined together in four non- 
EUtive focal plane processing procedures. Their properties 
and performance are studied in detail, using two types of 
images. One type is a set of twenty frames of real world 
infrared images with 10$ uniform drift between frames. The 


Second type is computer generated images which use two Markov 


ΓΩ 
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ERusesses to model the correlated noise which is assumed to 
EE og simulation of the real world background clutter. 
Meenas recently been brought to our attention that the Markov 
model was found to be an acceptable simulation of the back- 
Na clutter based on recent work on a tactical infrared 
hostile weapon location system.* With the computer generated 
model, a wide variety of images with varying statistical 
properties can be generated with ease. 

Both background clutter suppression performance and 
target detection performance are evaluated by computer sim- 
ulation using both types of images. Using the real world 
ENSred images, a background clutter suppression of 27 db 
is achieved bv a single frame spatial filter. Using a five 
frame spatial-temporal filter, a suppression of 87 db is 
achieved. These results are the most important testimonv 
Bene practical usefulness of the nonadaptive statistical 
tes because they have been used by other research groups 
and considered as one of the "standard" test scenes.  Com- 
Non with results of other groups is difficult in this 
unclassified studv because the absolute calibration of the 
image signal is a classified number and was not made avail- 
able. It should be acknowledged that the real world infrared 
image test described by figures 6-11 to 6-18 was made bv 


Sapicain D. Hilmers and was renorted originally in Ref. 50. 


οσο. ΠῚ Lincoln Laboratory, private communication, 
and to be presented in the SPIE 1979 symposium, Washington, 
Beer, April 17-18, 1979. 





EN Adaptive Focal ο πο Processing 

I Nn Eu η πα ΠΠ adaptive statistical spatial 
filters based on the minimization of mean square error cri- 
Bere developed for clutter suppression. In Chapter VII, 
BEN | Dtive procedure is deyeloped using computer generated 
Mu onary'" images whose statistical spatial correlation 
Euer tres are uniform. In the following chapter, με ΤΙ 
cedure is applied to computer generated "nonstationary" images 
momen nave four different statistical spatial correlation 
1165 in a given image. It is found that using a small 
Seems array ot 8x8 pixels, better clutter suppression can 
be achieved compared with nonadaptive statistical spatial 
οὓς, Using the adaptive approach, the resulting proba- 
τος false alarm (Pe, J of the adaptively filtered and 


thresholded image was found to be more than twenty times 


Exc than that of the four possible nonadaptive filters. 


ome CONCLUSION 

EN uetusion, five nonrecursive statistical focal plane 
Eueessors have been developed. The usefulness of this new 
Bene of Clutter suppression has been demonstrated by apply- 
me@oecthese nonadaptive filters to a set of real world infrared 
images. Although the adaptive spatial filters have been 
mested On computer generated images, it is believed that good 


ter suppression can also be achieved on real world images. 
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Neither the concepts of nonrecursive filters nor that of 
statistical estimation are new. However, the combination of 
these two concepts to process two and three dimensional images 
Or very low signal to noise ratio for suppression of "colored" 
clutter noise and for substantial enhancement of target signal 
to noise ratio up to several ten's of db's has not been 
NE orted before. The contributions of this thesis to the 
advancement of focal plane processing techniques for the 
enhancement of point/line targets and the suppression of 
Butter are highlighted in the following. 

IE Nonadaptive Focal Plane Processing 

a. One dimensional statistical estimation techniques 
med Of the Minimization of mean square error criterion 
Miner filter) and the maximization of signal to noise ratio 
Criterion (matched filter) are extended to two dimensions for 
Ains le frame and to three dimensions for multiple frame 
focal plane processing. They are different from other mul- 
tiple dimensional image processing studies because special 
ENSRndsis is given to the suppression of clutter which is 
Ια Ὧν correlated noise. Furthermore, target signals 
several ten's of db's helow clutter noise are considered. 
maces of such low signal to noise ratio have not been con- 
Sidered until motivated by the recent interest in smart sensor 
Systems. 

Pw icmeitecet suppression is accomplished by per- 


forming an estimate of the target. This is different from 


(ο 
A 
«o 





memer approaches which first estimate the clutter and then 
ου ος it by subtraction from the estimate of the target signal. 
Adaptive Focal Plane Processing 

a. One dimensional nonrecursive adaptive filter 
techniques based on the least mean square criterion are ex- 
tended to two dimensional single frame focal plane processing 
With special emphasis on the suppression of correlated clutter 
Er sseveral ten's of db's higher than the signal of interest. 

bee precedure to derive the desired response corre- 
sponding to different tvpes of target signals is developed 
meen 1S used in the adaptive process as the optimal response. 

em ine adaptive loop gain is set by an "automatic 
Mco ntrol” procedure which includes several requirements 
simultaneously to yield constant misadjustment for varying 
Meaerstical properties of the clutter, to prevent overflow 
and to assure adaptive convergence. 

d. A procedure for dividing images whose statistical 
properties are nonstationary and unknown a priori, into sub- 
Busse zones for filter adaptation is developed which minimizes 
the degree of nonstationarity and improves the performance of 


Baaptation. 





APPENDIX A [Ref. 14] 


GENERATION (MODELING) OF TWO-DIMENSIONAL RANDOM FIELDS* 


ES INTRODUCTION 

Any monochromatic image can be modeled by specifying its 
enue (gray level) f(m,n) at each spatial coordinate (m,n). 
An ensemble of such images can be modeled by interpreting 
Eras a random field. A class of images with particular 
Eu; correlation can be modeled by a random field with 
the same autocorrelation function. 

When spectral factorization in two dimensions is possible 
E56], the autocorrelation function of a random field is 
"σα το the transfer function of a system that generates 
Maen random field from a set of uncorrelated variates. Then, 
Meecitying a class of images by their autocorrelation func- 
Bon specifies a dynamic model representation for these images. 

Or a discrete random-field, the dynamic model is a 
Partial difference equation that can be represented by a two 
BeemensiloOnal recursive relation. The problem in this Appendix 
is to find a linear equation that represents a given random 
field. A discrete two dimensional random process with two 
memes Of autocorrelation functions will be considered. 

The presented method uses the spatial frequency domain 


to generate the requested random field. 


*Excerpt from thesis by D. Bar-Yehoshua, "Two Dimensional 
BHeurecursive Filter for Estimation and Detection of Targets," 
Naval Postgraduate School, June 1974 [14]. 
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B. SPATIAL FREQUENCY DOMAIN METHOD (TRANSFER FUNCTION) 
ioe introduction 

The discrete power transfer relation, for linear 
της of random signals, is useful for designing signal 
Ecessors. if we like to generate a random field with given 
we relation function, we can find a transfer function 
msush which an uncorrelated random field at the input (white 
EN s will give a defined discrete power spectrum density at 
Bie output. 

Figure A-1 shows the relationship between a white 
Meese input signal passing through a linear filter and the 
resulting output. In this case, the discrete power density 
Ee input is the 2-D unity function, and the discrete 
power density of the output equal to the absolute square of 
the filter transfer function. 

The transfer function method procedure can be written 
Erollows: 

ERE Eom the sautocorrelation function of the random 
field to be modeled, find the discrete power spectral density 


meme z transform. 
S(zi A ER Tt (A-1) 


b. Assume that the discrete power spectral density 


ms. 


2 : 
S(z, 22) - ΓΗ (21 25)| Ξ [σι 22) (21 PD (A- 2) 
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IO separate τ ποπ ορ εὐ get H(z, 22) as a trans- 
fer function of the random field model, according to eq. A-2. 

c. Using an uncorrelated random field as an input to 
H(z, 25), find the dynamic model of the designed random field 


in the z domain. 
UTD = A 25) (A-3) 
where Utz, 22) is a random white noise signal. 

Convert the dynamic model to a spatial model by 
eA Se z transform. In this process it is assumed that the 
ΙΙ field is stationary and ergodic. In this section the 
dynamic model for two autocorrelation functions will be con- 
sidered. 


2. Dynamic Model of One-Dimensional 
Autocorrelation Function R(t} = Og*p 


mU -ucHeeautocorreiation runctiom ot one-dimensional 


random signal as: 


2 | 
R(m) - "d NE) 
The discrete power spectral density will be: 
E 
Ip * (1-05) 
S(z) = == — (A-5) 
ο πο πι 
y 2 y E 
ση" 1-20 ση" l-o E 
ees! |! 
jue qp 
Bor the transfer function will be 
NE 
OR* E 
He ο ο στ (Α- 6) 
ΠΠ 





ΝΠ the output for such transter function: 


ayg[ 1-0 
giz) = Hebyet (zy = ————_. . F{z) 
jc aet 


If we replace the inpu- by white noise, we will get 


Mie dynamic model in z domain: 


oz *g(z) * πο (A-7 ) 


li 


g(z) 


Or in time domain: 


Po nsus) 5) 
where u(n) is a white noise with variance S us ir 


Eq. (A-8 ) represents a dynamic model for a one-dimensional 


iust order Markov process. 
3. Dynamic Model of One-dimensional Autocelleration 
Function R{n) = op 20 Micos (wen) 
Given the autocorrelation function: 


R(n) = eto P lcos(u-n) (2299) 
The discrete power spectral density will be: 


a * bz 





2 
S(z) * ag *(1-p^y - 
(Io p Cos uzp ) 





A 
‘ — - (A-10) 
(1- 2p9-C0S wz τρ 
where 
ae ZR m > [1+2p-cos w+ p 
. (Au) 
b MS tio - IR SEDE EO 
2 
Note 1-2cosu*:;^ » 0 for 0«0 < 1 





SIDON μοι) το iC) ice ae we get: 


5 αυ. T 
ο ο ο ο ο (-ω 
l-2pscoswz + Pez 


There are two ways to represent the dynamic model of 


such transfer function. 


a. First way: 
"ΗΠ 


Substitute H(z) from eq. (À-12) and represent f as a white 


noise, we will get: 


Biz) = 20-cosw:z ++ F(z) - o? 7? (a) «og 1- o? [a e bz luco) 
aos 


The dynamic model in time domain will be: 
g(n) = 2p-coswg (n-1) - Nee Ce aR eae a Dn 
ns ( 4-13) 
is a random white noise. 


where u(n) 
The initial condition will be: 


assume pu xd s (us 


Ne Ww111 get: 


g(1) gg u (1) 


m Ere 253950 9g 15) 5*0 


Big MAA 


[Ac PS) 
state variable representation 


b. Seconda way - 


Let us define: 


NIS en sa onen) (A-16) 
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Bo that: 





=] 
-l1 - ο τσ] 
ER = Hiz)*z °F (Zz) = E 
t= 20*COs WZ nu c ¿72 ᾿ 
or 
= : ze PE -ἐ πι 
ΞΟ 2-D*cosu* z *G(z) -p.- z.-"G(z) *z * F'(z) (A-18) 


Let us define: 


602) 


p, (2) 


2 o2"La(z) (A-19) 


p5(z) 
Erom eq. (4-18) and eq. (A-19), we get: 


py (2) = 2p-cos uz > ES 2 hp(z) + RAD 


2 -1 
p5(z) pe z +p, (2) 


Meseexpression in the time domain is: 


p; (n) 2p-cosurp,(n- 1) ο ο 25 ΕΠ 


Z s 
p, (n) = pr. p,(n-1) (A20) 


Epressing eq. (A-20) in the state variable form, we have: 


p, (n) 2P-cosw;-l p, (n-1) | [ 1 
| = ED UN PIN p» | «f (n- 1) 
| P200) p i 0 Po (n-1)| m. 
for nool (A-21) 
where the output is defined as: 
N a p, (n) | 
n 12 DE | (A-22) 
i = | 
End. £f'í(n-1) = πιο” αι π) Ὁ υπ ο | 


where u(n) is a wh -te noise. 
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p5(1) & 
4. Dynamic Model of Two-dimensional 2 Im! In} 
Autocorrelatıon Functıon R(m,n) ντ ο «Dy 


Given the autocorrelation function 


R(m,n) = On p, Il p IP i) 
ED NdFPScrete power spectral density is (using eq. A-5): 
S(2, 25) = 51.21) 5222) = 
ο Op llop nV) 
pcs pe ο. 22) (1-0. no 


ir -1l 
Separating S(z, 22) to H(z, z5):*H(z4 ‚2, ) gives: 


ο ο“ 
Hoz: = E A - EM (RSS 
f Moz esos) 


and the output ot such transfer function: 
G(z, 25) = Hiz, 25)*u(z, 25) 
Metas the follcwing recursive equation: 


al 


2 - 1 
G(z 60027 27) See ze 25 G(z, 2) 


(A-26) 





le dynamic model in spatial domain will be: 


g(m,n) * py,*g(m-1,n) - oyp,cg(m-1,n-1) * o,-g(m,n-1) 


* ogl (1-6, 10-0, ) * u(m,n) CA- 27) 


for m,n > l 


Eon (A-27) is a two dimensional first order Markov 
ESGeSSS representation. 


me initial condition will be: 


ΘΠ rer) 


g(m,l) = Pp, *g(m-1,1) + ση 1-0, =u(m,1) m> 1 


g(1,n) = e,-g(1,n-1) * ogll-o^*u(1,n)  n»1 


where u(m,n) is white noise with variance l. 
This dynamic model was used by Habibi (Ref. 17] and 


can be characterized in a state space structure [Ref. 18] by: 


DESEE Or | 1 (nm) | 
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5. Dynamic Model otf Two-dimensional 
ο ο ο ο ποῃ Fune tion R (m, n) - 
2 T mi T 


ο >’ OS “m . 
R h ον cos (y )cos(w, n) 


Even the autocorrelation function: 


2 m n 
R(m,n) = Tp ρα | lo, ! |. cos (u, *m) *cos(u, *n) [c 


EEdiscrete power spectral density (using eq. A-10) is: 


Hu 


> 22) 5(2,)* 5(25) 





= ο =l a . p ce 
H, (24) Hi(24 ) H, (25) H,(z, ) LS 
where 
-] -1 _ PASS -1 
H(z) 25) = H, (2, ) H,(2, ) 
. Jl O 
- 1 -1 
αι ΤΟ; 
ME a I S a τσ 
(1: ἐρμςο» ze zz )(1l-2p,cos waz, +P 82, ) 
GS 
where 
> + 2 : a : 
E 1-204cos uy, Oy - | l«20:c0s u, * p, ° 
MMC ος κ τμ μες αμα ο ο. ο ο I 
h 2 
1-29.COS w, + - - [ 1*20;cos u τ ο c 
Uu. x hn ^h h mnn 
h 2 
- - (Α- 55) 
m. l-co,cosw, + P, + | 1*20,cos 4, t Py 
: 2 
IE ο SOS Ww η, - [1 + 20-cos w pé 
Moo e v> V V ας a X V 
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EN 
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H(2, 2;)*U(2, 25) 


Balculate G(2) ο andere zehestwo-dimensional inverse z 


transform, the dynamic model in spatial domain will be: 
ze 2 
g(m,n) E Cg (m,n-1) B Py EZ) 
» à 
* Crg(m-1,n) - C,*€,*8(m-1,n-1)+C,-p, eg(m-l,n-2) 
2 = oe e -- - = 2 e 2 - - 
o, gm η ND ον g (m Dn 1) p h Py g (m Zo 2) 


+ og! 70,7 -p f) -[ay sa, -u(m,n) * a, +a -u(m,n-1) 


* aj'by*u(m-1,n) * b,*b, *u(m-1,n-1)] (A- 34) 


uc 


where C 2*p4*COS Wy 


uu c 


2° *COS y 
V Py V 


and u(m,n) is an uncorrelated random field (white noise). 


The initial condition is: 


eee (1,)) Mo = 0 (When 009 5$ 1 (A-35) 
ο. σι. 1) = og 20,1) 


ο - for m» 1 - use-eq. (A-54) 


with ος = 0 and wy, = 0 and (eq. A-35) 
meu iso LS Use σα ο ο 54) 
η 


ο. 0 and uy 7 ) and eq. (A-35). 


Equation (A-5354) 23 a two dimensional second order Markov 


m ess representation, 





Mieco soi USPC ουκ 100 in size, formed by 


ου τοι (τα). representing the piven autocorrelation func- 
Mea. (A-3U! is shown in Fig. A-ı In this picture we used 
moe - 0.99 and ane = Mana a τε ΤΟΝ ΚΕΕ 0.145. Comparison of 


the correlation *unction R(m,n) of the simulated image to the 
mvemeimage yielded an average error of the correlation factor 


around 15. 


The state space structure can be found as follows: 


Let us define: 


l EN .. ην; E. ^ 
eee yy Ap up ο a b αντ ορ ) 
we get: (Α-56) 
2 * ΤῸ σὴ 
G(z1 25) : 23 Due. 
(1-2p,»cos ων ον. (1-2p,cos ΡΖ; ) 


By using the following definition: 


D ee a " 
pi(z, 25) = τι °P, PÁ2, 23) + 2) P4(z] 22) (A-38) 
- 2 
E. 0o gn) 
ην. n a δι 
MED a 
D 2 -] 
meee a, 2, Ῥῃί2ι 2} (A-40) 


η 22? (A-41) 
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G(z, 25) = P,(z, 25) (A-42) 
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cure A-2- A random field given by the auto- 
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ao D E "cos (w,*m)cos (w_-n) 
forming computer, using the dynamic 
model of eq. (A-30). (The DECIES 
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EDU 57 ean be represented us: 


> | - 1 
ME ou t t? P4UA 75) 
ΠΠ υπ. -Ῥῃίζι 12) 

ass : 
p3(2) 2) 7 ' P4 (Z) Z2) ( A-43) 


; = τ = . 7 al e Al 8 
ο ου... ο yee) Paley το ολ Ῥείτι 25) 


* 2 eut (z 
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2) 
EUnverting eq. (A-43) to spatial domain and putting in state 


Variables form, we get: 


| | | 
mens [ei ορ μι 1. men 
p,(m+1,n) = τ ο ην.» po (m,n) 
>= 
pz(m,n+1) oq 00 l0! -o,' T pz (m,n) 
p¿(m,n+1) 0 | 0 Ti Reycosay p¿(m,n) | 
0 
E 
* - 4 (m,n) (A-44) 
0 
D 
where 
p, (m,n) 
p> (m,n) 
ΙΙΙ, ES 
pz (m,n) 


| pamm) | 


and uw (m,n) tomaneumeorrelated random Meld given by: 





νη 
u^ (m,n) - Gp: (1-9, 7) G-e, [apay u m,n) + (A-45) 
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a, *b,*u(m,n-1) + a,b, u(m-1,n) + b, 'b,*u(m-1,n-1)] 
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PRENDE Bb 


BAYESE KRITERION 


E EVTEW OF ONE DIMENSIONAL CRITERION [32] 

In this appendix, a threshold setting algorithm will be 
Eusented, similar (but not identical) to the Bayes decision 
algorithm. First, the basic decision model in one dimension 
feel be reviewed. 

- Given a measurement sample x - 


E55: a 


N 


S desired signal 
n * noise 
- There is an unknown parameter O related to the measure- 


moe. Example: 


Een a pixel containing noise and "possible" signal, 


j 


Pixel (m) Pixel (m) 


En Fig. Β-](α) - 





Sao ps a) 


En pOSSible signal that has to be detected in pixel (m) is 


sown in Fig. B-l(b) - 
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51 xz 
Signal = s(m) | | 


"0 0 m 
Bergen) 
Fr ar 


The resulting signal plus noise samples are shown in Fig. 


ee) - 


Measurement samples = x(m) ze m 


Darse m) 


pacc e 


The unknown parameter (''event") 8 - 


Given the conditional PDF's 


P[x/9g] P[x/®,] 


Buch as shown in Fig. B-2 - 





P[X/9, ] 





Border to determine whether the signal in pixel (m) 


1S Sy ors the following definitions have to be made: 


Hz 


- Define the following decision errors: 


cee CCl When correct 
DS i P[X/0,]àx 
8 = Accept when false 
5 5 τ ει Olax 
l 


- Define the following costs: 


1 


when not true 


C Cos deerding "Sg 


M 


Coctwot miss 


nt 





CEA à Cost of deciding "Si" Weno SECTIO 


ll 


Cost of false alarm. 
Meaetne Bayes solution there are two additional cost 


moms which are not required here.) 


- Define the risks: 


Em 8 = Ro 
Cay’ ἃ = Ry 


- Given the probability of "event" 8 Ra event “sor 


0 
no target) 

Beeren the probability of "event" 94 > g, > l-gy ("event" 
of target present) 

memes total risk can be found by combining all the defini- 


tions above and is given by: 


R= g eR, + g,-R 





E τ διπλα κ... 
VrH co 
ιο; ΠΠ Borah P[X| 0] dx 


TH 


- . dR _ 
EN DnImizing R with respect to Vry (στι Ὁ) yields 


the following threshold equation: 


V _ 2 V 
ME OH) eal e, Cpa PE THO EE 
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When all the parameters are known, we can solve (5-2) 
for the threshold level. The following two definitions are 


useful: 


P[X|91] NM 
ExPSS T ^09 eS 


A(X) 


¡> O 


Wi kelinood ratio 


S ofM 
HL —- ( B-4 ) 
SI “FA 


im η 


k Bhreshold ratio 


Example 


Given a measurement X that can belong either to = or X1 


where - 





Ders normal PDE. 


Decide whether X belongs to ώς Or Xy + 


- Decision method: 
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P[X,/0] » —-— ,- x^/2a^ 
210 
] (X=1)4 
EAE T —— 7 > 
¥ 2710 20 
Des δ ΟΝ 
Bud 
SI FA 
assumed to be specified. 
CM Cra? So? 81 j 
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ime likelihood ratio is: 


„- &-u)? /20° 
A(X) = pe = K 
E 70219 


The threshold level is: 


V = 


d B-5 
TH ln K ( ) 


bjE 
+ 
ES 


Mmenwaecision algorithm: 


when X > V i De FOG ο X 


Ti i 


when X < V WS ioe iene ie) 


TH 0 


τ Extension to Two Dimensional 
Mibtivariable Criteria 


Following the one dimensional case, we can 


πο the signal to be a vector rather than a scalar. 


The signal is S = [51 35. 5τ] 

The noise is N = [n; m, eng] 

The measurement is X = ο... Xr), 
Er. 


For the multivariable normal PDF, the Bayes 
won requires that the vector X will be filtered first 


by a matched filter and then compared with a given threshold. 


ais conclusion can be demonstrated as follows: 


The multivariable normal PDF is: 
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Pme 1/2 Εχρί[- ΣΝΕ ΝΤ (5-6} 


| D NN 
ΙΤ, 


ANE muerta te normal PDF 


Run Move Trance matrıx of the noise 


E[N] N] (assuming E[N] = 0) 


The noise vector can be presented as follows: 


y 5 - στ 
T T 
(X E So ) 


A point target can be expressed as: 


S 


1 EUMD E. g(m,n),0] -5 


NE 5 5; 0] 5.0 
The likelihood ratio is given by: 


LL - T 
a a 57) 1 
= ee ee eK 
Ens the natural log of (B-7) will yield the 


required conclusion: 


ze -1 T Í T 
EN E MO O OS 
2 al _ ιο) 
X-Ray S704 
where 
Ban EE 
C1 75595Ra > 





<Ink+C] > S 
z | c z τ᾽ 
r 


vecto filter 


7 ink+C, e S} 


as described in Fig. B-3. 


i= target 
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APPENDIX C 


DERIVATION OF ADAPTIVE FILTER ALGORITHM* 


A. ALGORITHM DERIVATION 


EE sven pixel, the output of the filter is 
Vo NE N. cc) 


NX select a desirable reference performance, d., 
Me seek to achieve at the steady state. For example, 
Ene case of point target detection (or estimation), we 
Eo achieve the best estimate of a point target while 
E cessing the background clutter noise as much as possible. 


Nus define the error = Ito con] Co De 
eee cee Vy dl WO ΓΕ: 


INE the purpose of the adaptive process to adjust the 
Mementing coefficients of the linear adaptive filter to 
minimize the mean square error, zn 

The derivation of the adaptive algorithm is started by 
Memsidering the k-th step of adaptive iteration. The mean 


mare error is given by 


2 2 T T T 
- = d. E ΤΩ PA. W + W Xm κ. W 
= j SU ck kN 


(C- 5) 
Mm@emstatistical expected value is obtained by averaging (C-5) 


Over an ensemble of identical adaptive filters. 


Mis tappendix is based on the original derivation of 
Pee Widrow [21,22]. T" 





: ELE Era. Xk. mem 


_ T T 
Ele d ewk j γη uw 


ETA W 
I jd κ 
ΓΕ ο) 
Let us define a vector P as the crosscorrelation between 
mmerdesired response and the X- vector. 


pl T 


jl = E[d;X} d; Xo ,..d;Xi ] 


= E[d;X 
j j j 


(C-5) 


The input correlation matrix Be is defined in terms of 
the ensemble average 
(X1 X4 J)(xi x5 J. 


x^ BU, 1 -|{χ; χι)... (C-6) 


(Xr Xr ) 


The mean square error δι can be expressed as 


orice = ps We RW en 
k j NU NE n 


[eis 2 quadratic function of the coefficients. Adjust- 
ing the coefficients involves descending along a concave 
Myperparaboloidal surface with the objective of reaching its 
minima. Gradient method is commonly used for this purpose. 
The gradient D of the mean square error function at W - Wye 


is obtained by differentiating (C-7) 
2 
3Ele;] 





UN IEEE. | = - 2P + 2R”? Wy 


au w = wk (C- 8) 





The optimal filter W*, generally called the Wiener filter, 


obtained by setting the gradient to zero and is: 


23%) 





For some of the subsequent analysis, it is convenient to 
express the mean square error Ex (C-7) and the gradient 
function (C-8) in another form to be derived as follows: 


Eustituting ( C-9) into (C-7) will yield: 
Baur ο (C-10) 


E wubungome" (C-10) with (C-7) and (C-9 ) wall yield: 


τ, , ;; d 
Ere now - ws (0512) 
k k ) 
Amate gradient becomes 
= ¿RV ο 15 
Simce R are ceorre lat on ME LESE ooSitive derf- 


meee and may be expressed in normal form as follows: 
HS 7 Ll 
ου ιο 0 a 


where A is a diagonal matrix of the eigenvalues of R. If Q is 


constructed to be orthonormal, then us - gt and then (eas) 
eon ος (Sd 


Eundethe mean square error may be expressed as: 





T 
Sk N en t VE QAQ Vk n) 


A new set of coordinates may now be defined as 


ο το (6518) 

vT - γὶρ | ( C- 19) 
and 

Sk F Smin li Vg AV. cn) 


Mas transformation projects V into prime coordinates. 
Since A is diagonal, the prime coordinate must comprise the 
principal axes of the quadratic mean square error performance 


surface. The gradient expressed in primed coordinates becomes 


uS - 2A V." (S221) 


ENEMIES METHOD OF STEEPEST DESCENT 

tive objective of the adaptive process is to find a 
τοπ το (6-9). It should be noted that (C- 9) has exactly 
ne Same form as the equation in Chapter III for designing 
mme spatial MMSE filter. 

νν.'' τΠππεετ, ποπαάαρτινε filters were developed. 
Euution of (C-9) required a two step process by first 
EN3tins the statistical properties of the image and of 
me targets, then followed by a solution of a set of linear 


equations. 


ο 





IN DI:echui»pter). adaptive filters are being developed. 

E Uternative approach is used, based on the steepest descent 
adaptive method. 

Méeradaption in this method starts with an initial value 
assigned to the filter ee The gradient of the mean square 
OS measured and the filter coefficients are modified 
ιιαιπν. This procedure, when repetitively applied, 
causes the error to reduce successively until the filter 
approaches the optimal value. This method can be described 


Ex De following relation. 


(C- 22) 





where u is a parameter (loop gain) that controls stability 
αι Oonvergence rate, Vx ιτ" aducEosmEPbcesrradrent at a 
meme On the error surface corresponding to W = Wy. 


An expression for V, ο ο οι ο. ο ο SSubstituting 


EM unto (C-22) will yield 


= _ ος 
Well 7 Wy 7 2u RV, (oz, 

BE esacting W* from both sides of (C-25) will yield 
eee 2WRY. e (1 - ZUR) Y (C- 24) 


Bacon 6-24) 1s a linear homogenous vector difference 
equation whose solution characterizes the dynamic behavior 


EN Ue adaptive filter. The solution to (€C-243) is: 


AS URS 


k O 
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NUES stable if 


EO E (C-26) 
ko 
Since "τν, απ. πο (C-27) 
and ERE S EN SP (2285 


Semaition (C-26) will be satisfied if 


Bao (C-29) 
Ko 


xudson (C-29) will be satisfied if 
[51 (C-30) 


Den = 1,2...| 





5 Tg 0 CSL) 
max 
À 
max 


where is the largest eigenvalue of R 


xX 
Equation (C-31) gives the stable range for u. 
It can be seen that in primed coordinates, the coefficient 


equation given by 


11 = y1 C-32 
kel π᾿ k ( ) 

with the solution 
V oe Au N ES 


Mathe p th coordinate we may write 


, ΕΙ E 
Vk - (1 - 2uA,) M ο ο) 
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IE 54) represents a geometrical progression for v 


pk 
eins from the initial condition Uo 
ite geometric ratio of the p coordinate is: 
ea = LUA) C255 
D ( μ 21 ( ) 


Since we prefer to talk usually in terms of exponential 
mu sron, we can fit an exponential envelope to (C-55) 
with time constant, το If the unit of time is one itera- 


Brom cycle, then 


τ. - exp( ^/1,) =] - 


p (0290) 


practical applications, u 1s selected so that δ 72 3: 


ENEEES S6) can be approximated by the first two terms only. 
M@empaming (C-56) and (C-55) gives the formula for the p-th 


time constant 


H 
ll 


eo | a — 
p 


_ 1 x 
ο... TX (6-27) 


Therefore, we can summarize that the transients in the 
coefficients of "filter V" are geometric sequences with an 
Buspoximate time constant, Το" ιν ως επι ποπ noc- 1n 
meme Coordinates) the transients will consist of sum of 
geometric sequences, with the total number of time constants 


Mmeobeatiy equal to the number of coefficients. 





Similarly, while the coefficients are varying, the mean 
ΙΕ error (MSE) varies as well. Substitution of (C-53 ) 
906-70) will yield the "learning curve" - the MSE as a 


Eunction of k: 


a t = 
ΥΠ ο “ACV ο. 


As long as condition (C-54) and (C-31 }) are met, the adaptive 


ENS will converge on the minimum point of the MSE surface. 


lim €, = ee 


E : 
Ms min 
ea alo, the relaxation process is a sum of geometric 


sequences where the p-th mode has a geometric ratio of (1- 2uA,)* 


Εις in a time constant 





τ ο D 2 
Anse Te 2 (C-42 ) 


To accomplish the coefficient's adaptation, we have to 
measure or estimate the gradient at each iteration. Reference 
[21] suggested two methods to obtain the gradient estimate. 
Meemiirst method uses differentiation and requires that finite 
perturbations De mde on πο medcmts The 
second, so-called LMS method, obtains gradient estimates 
ΕΙ and without perturbing the nominal coefficients 
adjustment. 

In this work, the second method was selected, based on 


WO reasons. 





Practical implementation and utilization of this method 
me am eaae oompare d to the other alternative. 


Me erence [21 ] demonstrated the superiority of the LMS 
algorithm with regard to convergence time and mean square 
Error, compared to the other candidate. 
C. THE LMS ADAPTATION ALGORITHM 
EHESLMS algorithm is an implementation of the steepest 
descent method that employs an efficient gradient estimation 
technique. This method was found applicable to the two di- 


mensional filtering configuration presented earlier in Fig. 


5 
ieee Gradient Estimation, Convergence and Time Constants 
ime error, Ei OEC ορ such as shown in Fig. 7-2 
is given by (C-2). A gradient estimate may be obtained by 


emang the single value of E; απ ος ποπ ος πο τί ας If 


it were the mean square error: 











N 
ος. ge 
3 : 
R E RE (C-41) 
V = . zc 9 Ξ Εκ 
J } * ἡ 
E a 
ΝΤ OW y 
JE 
“σσ. - d. - wix. TE eng 
J J z QW J 


(Ca) 





wee index k is replaced by j since we perform an adap- 
entep ror each new input vector, i.e., a new set of 


data samples. 


Tae 





mae eradient estimate ot (C-41) may be implemented in a 
practical system without further squaring or averaging and 
is simple and elegant. All components of the gradient vector 
memencained from one input data set X. Since the estimate 
memebeained without averaging, it contains a large component 
of noise. The noise, however, is averaged and attenuated by 
the adaptive process, which acts as a low pass filter in this 
ao pect. 

E portant to note also that for a fixed value of 
W, the estimate is unbiased, which can be shown as follows: 


x T > 
re = Ed Key Ca 
LV i] Le 4X 4] '' XX. WI ( 3) 


Erom (€C-8 ), this expression can be rewritten as 


E[V ;] = -2(P-RW) = 7 de) 


Ene that v is approaching zero at steady state. 
EN U uucseence of the Mean of Filter Coefficients 
Let us now show that the mean value of the filter 
eoerrsicient instead converges to a steady state when the LMS 


EE is implemented, Taking the expected value of 


(C-42), we obtain the following: 


tT 

(7-3 
---- 

= 

C 
ll 


! ETA WEIN de u 
ji M) j93 734 5 


E ο ο ο) ο. 59 


In obtaining (C-45), we assumed that W and X are 


Euncorrelated. It will be shown later that proper selection 


ο. 





EN scadaptation loop gain K will cause the filter coeffi- 
Semis LO vary very slowly compared with the value of the 
ENSE CN X) correlation coefficients. 


T 


a 


where W is considered almost as a constant relative to 
T 2- ; T ο Τ 
HN Under these assumptions, E[x °w] = Efx I-:E[w], i.e., 
X and W can be considered uncorrelated. 
ΠΠ back to equation íC-45), with an initial 
miter coefficient, Noa Ἱ τι απ πα εισηςσ tos tequation (1-45) 
yield 


j 
W [I + ZuR 1} ὋΝ εν; {ΠΝ ]^P (C- 46 ) 


Ἐν. | 
ο ¡20 XX 


J: 


6) may be put in diagonal form by using the normal 


expansion of o enat 1s, 


Mmmemecicenvalues are all positive, since Hm is positive 


definite. Equation (C-46) may now be expressed as 
Eoi = [Ir ug aan - tud [De2 ot ag} iP = 
= QU p1+ 2un1Í "0-0, - nq in *2u A]  Q*P(c.45 
Menmsader the diagonal matrix [I+ 2A]. As long as its diagonal 


memms are all of magnitude less than unity 


1im[1 + 2uA]?**+ 0 


j>% 
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EudEthe first term of (C-47) vanishes as je. 
The second term in (C-47) converges to a non-zero 
limit. The summation factor - 


DN + 2un] Í 
1=0 

J - 
becomes limas [I *2uA]* = - E A : 


E 1=0 
where the formula for the sum of the geometric series has 


been used, that is: 


oo : i _ 1 S 
E (1% Zu) 1- (18203) Ζμλ 





Thus, on the limit, equation (7-49) becomes 


0η οἵ this result with (€-9.) shows that as the 
number of iterations increases without limit, the expected 
value of the filter coefficient converges to the coefficients 
ot the Wiener filter. 

The convergence is assured if, and only if, u is set 
Ben certain bounds. Since the diagonal terms of [I+ 2uA] 
must all have magnitude less than unity, and since all eigen- 


Memes ili A are positive, the bounds, on u, are given by 





| 1 2 DE EU 
-1 
< <a) 
^max 


ΓΩ 
I 
un 





where Amax is the maximum eigenvalue of ee This convergence 


Esnditron can be related to the total input signal power as 


follows: 

Amax « trace = 

(C-48) 
A T l η | 
pace [22 | s EINEN] E Elx] = total input 
= ES 1=1 > power. 

Therefore, the bounds for satisfactory convergence are 

s= yE 75 

: 2 

SEIX | 

fa - 


Eusetrcal applications, when precise adaptation is required, 


Meets usually selected such that 


(C-49) 





EN The Noise of Gradient Estimation 
Let it be assumed that the adaptive process, using a 
snall loop gain u, has converged to a steady state near the 
minimum of the MSE (£). The gradient estimation noise of the 
mioeaicorithm at the minimum, where the true gradient is zero, 


Buche gradient estimate itself: 


τ. τες. C250 
0 Sm en 
Since y. EUN Sole 
J J J 
where E οἳ πο true gradient 
Ni - gradient noise vector. 





Hl Eeovariance of this noise is given by 


T 2 T Ν 
Covi N ; = EIN.N. = ea c cS 
ov[N;] - ΕΝ.Ν, Ἴ [ej xx] (ς-51) 


It is known from Wiener filter theory that when c - W* [the 
optimal filter] the error Ξ ΕΤ the input 
vector E If one assumes that e and X; are Gaussian, they 


will be independent, as well, at the minimum. Under these 


Ewdrtrons (C-51) becomes 


= . T = ξ ΕΕ; 
ΙΙ; EE ] M T ] = ane x 52) 
In primed coordinates, the covariance is 
! = zd Za «ἃ ας 
ο 0 eeu e PES: (USO) 


NO ise in Filter Coefficients 
Adaptation based on noisy gradient estimates results 
in noise in the filter coefficients. The method of steepest 
descent with ideal gradients is represented by (C-29). With 


estimated gradients, this equation may be rewritten as: 


V;4i 7 V; * uCY = Vp + (CY, - NS) (6-54) 


where the estimated gradient is i: 
PEubstituting (C-15) and combining terms yields 


E m> τ 
por (I Zu Re) V: E du 


This isa first order difference equation with a stochastic 


ing function of EM Projection into primed coordinates 








Mey be accomplished by premultiplying both sides of (C-55) 
EQ. 


Ws 9 Cho Avi ie NE C-36 


In steady state, after initial adaptive transients have died 
But, Y undergoes a stationary random process in response to 
Miemstationary driving function, E oince there is no 
cross coupling between terms and the components of Ny are 
fiery Uncorrelated, the components of Vz will also be 
mutually uncorrelated, and the covariance matrix of AE will 
Mematagonal. To find the matrix, one first multiplies both 


1: (C-56) by their transposes. 


V JE T 


- T 2 
! = c ΠΠ - ! : 
V ΠῚ μι m 2uA) V. il (a A a 


B u (I is ek 5 Doa τ - 2uA) 
[57 


Taking expected values of both sides yields 
cov[V*j] * (I- 2uA)cov[Vj'] (I- 2uA) * u^cov[N;'] 
(sss) 


(Note that p E are uncorrelated since E is affected only 


by gradient noise from previous adaptive cycles.) 


ΟΠ ΠΙΕΡ terms further yields: 


2 , 
sork i τα “cov[N";] τμ» 


practical applications, when u is small, 


1 





μῶν c 
E u-cting the squared terms in (C->9) 


Sa 5 = 7 A “cov [Ny ] 


@empomming (C-59 ) with (C-52), one may write 


al 


cov[V*] = H NC Ὁ- I (C-60 ) 


“Smin 
Iu -aceovariance of Ve can be obtained from (C-60) by using 


E16) and (C-18 ). 


y 1 E = o E = - 
j DEUS oc DIG DEEST 


Mom 


cov[V;] - E[QV,' V 


eee Misadjustment 

Without noise in the weighting vector, adaptation by 
"πο of steepest descent would converge to a steady- 
we olution at the minimum point of the MSE surface. The 
MSE and the minimum will be in να; ::πειπρ 
Er. however, tends to cause the steady-state solution to 
Es ndomly about the minimum. The result is an excess mean 
square error, a mean square that is greater than ct 
Aimexpression for mean square error in terms of V' is 


even by (C-20), where the excess mean square error is 
a 


Ma IM he average excess mean square error is 
T I 2 I 
HC MU O '"O L5 u$ . 2 Ap 
p min 


Eus. according to (C-6]), 





Qn e 
Ge NE ue in Lor all: P 


Pj 


A useful parameter in the design of adaptive processes 
is the misadjustment M, which is defined as the average excess 
mean square error divided by the minimum mean square error. 


B 
ΕΙ ΗΝ. 


SY 


min 
The Misadjustment is a dimensionless measure of the difference 
between adaptive performance and optimal Wiener performance 


as a result of gradient noise. The misadjustment is thus 


given by 
05) 





“1 formula may be re-expressed in a manner that 
allows one to perceive the relationship between misadjustment 


and rate of adaptation. According to (7-42) one may write 





"Ho pe (0-64) 


X 





Te T | ) (C-65) 
Dase es 
Where I is the number of filter coefficients and τ ls 
mse 


HEN E time constant, related to the learning curve. When the 


eigenvalues are equal, 





) (C-66) 


EN | l 
ιτ 


res © 





peice trace Ry y ΙΙ ΓΘ; power Of the input vector X, 

which is generally known, one can use (C-63) in choosing a 
value of that will produce a desired value of M. Combin- 
ing (C-66) with (C-63) will yield a general formula for the 


time constant of the learning curve with equal eigenvalues. 


" f I (C267) 


mse ΕΤ Rex 


This formula is also a good approximation in many cases when 


the eigenvalues of R are unequal. 


XX 
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